/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
1692.7.6 by Martin Pool
[patch] force deletion of trees containing readonly files (alexander)
1
# Copyright (C) 2005, 2006 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
17
1185.1.2 by Martin Pool
- merge various windows and other fixes from Ollie Rutherfurd
18
import os
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
19
import errno
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
20
import warnings
1113 by Martin Pool
- fix is_ancestor import problem in merge
21
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
22
from bzrlib import (
1551.19.17 by Aaron Bentley
Add debugging flag for merges
23
    debug,
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
24
    errors,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
25
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
26
    patiencediff,
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
27
    registry,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
28
    revision as _mod_revision,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
29
    )
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
30
from bzrlib.branch import Branch
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
31
from bzrlib.conflicts import ConflictList, Conflict
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
32
from bzrlib.errors import (BzrCommandError,
1534.4.28 by Robert Collins
first cut at merge from integration.
33
                           BzrError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
34
                           NoCommonAncestor,
35
                           NoCommits,
1534.4.28 by Robert Collins
first cut at merge from integration.
36
                           NoSuchRevision,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
37
                           NoSuchFile,
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
38
                           NotBranchError,
1185.33.27 by Martin Pool
[merge] much integrated work from robert and john
39
                           NotVersionedError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
40
                           UnrelatedBranches,
1534.10.12 by Aaron Bentley
Merge produces new conflicts
41
                           UnsupportedOperation,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
42
                           WorkingTreeNotRevision,
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
43
                           BinaryFile,
1534.4.28 by Robert Collins
first cut at merge from integration.
44
                           )
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
45
from bzrlib.merge3 import Merge3
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
46
from bzrlib.osutils import rename, pathjoin
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
47
from progress import DummyProgress, ProgressPhase
3052.1.3 by John Arbash Meinel
deprecate revision.is_ancestor, update the callers and the tests.
48
from bzrlib.revision import (NULL_REVISION, ensure_null)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
49
from bzrlib.textfile import check_text_lines
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
50
from bzrlib.trace import mutter, warning, note, is_quiet
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
51
from bzrlib.transform import (TransformPreview, TreeTransform,
52
                              resolve_conflicts, cook_conflicts,
2590.2.8 by Aaron Bentley
Restore conflict handling changes
53
                              conflict_pass, FinalPaths, create_by_entry,
54
                              unique_add, ROOT_PARENT)
1551.15.46 by Aaron Bentley
Move plan merge to tree
55
from bzrlib.versionedfile import PlanWeaveMerge
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
56
from bzrlib import ui
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
57
58
# TODO: Report back as changes are merged in
59
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
60
1185.35.4 by Aaron Bentley
Implemented remerge
61
def transform_tree(from_tree, to_tree, interesting_ids=None):
62
    merge_inner(from_tree.branch, to_tree, from_tree, ignore_zero=True,
1558.1.3 by Aaron Bentley
Fixed deprecated op use in test suite
63
                interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
64
1457.1.12 by Robert Collins
Update comment to reflect author.
65
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
66
class Merger(object):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
67
    def __init__(self, this_branch, other_tree=None, base_tree=None,
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
68
                 this_tree=None, pb=DummyProgress(), change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
69
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
70
        object.__init__(self)
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
71
        assert this_tree is not None, "this_tree is required"
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
72
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
73
        self.this_basis = _mod_revision.ensure_null(
74
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
75
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
76
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
77
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
78
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
79
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
80
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
81
        self.base_tree = base_tree
82
        self.ignore_zero = False
83
        self.backup_files = False
84
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
85
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
86
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
87
        self.reprocess = False
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
88
        self._pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
89
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
90
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
91
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
92
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
93
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
94
        self._base_is_ancestor = None
95
        self._base_is_other_ancestor = None
96
97
    @property
98
    def revision_graph(self):
99
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
100
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
101
        return self._revision_graph
102
103
    def _set_base_is_ancestor(self, value):
104
        self._base_is_ancestor = value
105
106
    def _get_base_is_ancestor(self):
107
        if self._base_is_ancestor is None:
108
            self._base_is_ancestor = self.revision_graph.is_ancestor(
109
                self.base_rev_id, self.this_basis)
110
        return self._base_is_ancestor
111
112
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
113
114
    def _set_base_is_other_ancestor(self, value):
115
        self._base_is_other_ancestor = value
116
117
    def _get_base_is_other_ancestor(self):
118
        if self._base_is_other_ancestor is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
119
            self.base_is_other_ancestor = self.revision_graph.is_ancestor(
120
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
121
        return self._base_is_other_ancestor
122
123
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
124
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
125
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
126
    @staticmethod
127
    def from_uncommitted(tree, other_tree, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
128
        """Return a Merger for uncommitted changes in other_tree.
129
130
        :param tree: The tree to merge into
131
        :param other_tree: The tree to get uncommitted changes from
132
        :param pb: A progress indicator
133
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
134
        merger = Merger(tree.branch, other_tree, other_tree.basis_tree(), tree,
135
                        pb)
136
        merger.base_rev_id = merger.base_tree.get_revision_id()
137
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
138
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
139
        return merger
140
141
    @classmethod
142
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
143
        """Return a Merger for a bundle or merge directive.
144
145
        :param tree: The tree to merge changes into
146
        :param mergeable: A merge directive or bundle
147
        :param pb: A progress indicator
148
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
149
        mergeable.install_revisions(tree.branch.repository)
150
        base_revision_id, other_revision_id, verified =\
151
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
152
        revision_graph = tree.branch.repository.get_graph()
1551.15.77 by Aaron Bentley
Merge from bzr.dev
153
        if (base_revision_id != _mod_revision.NULL_REVISION and
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
154
            revision_graph.is_ancestor(
1551.15.77 by Aaron Bentley
Merge from bzr.dev
155
            base_revision_id, tree.branch.last_revision())):
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
156
            base_revision_id = None
1551.19.22 by Aaron Bentley
Add warning when merge directives cause cherrypicks
157
        else:
158
            warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
159
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
160
                                         base_revision_id, revision_graph=
161
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
162
        return merger, verified
163
164
    @staticmethod
165
    def from_revision_ids(pb, this, other, base=None, other_branch=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
166
                          base_branch=None, revision_graph=None):
1551.15.74 by Aaron Bentley
Textual updates from review
167
        """Return a Merger for revision-ids.
168
169
        :param tree: The tree to merge changes into
170
        :param other: The revision-id to use as OTHER
171
        :param base: The revision-id to use as BASE.  If not specified, will
172
            be auto-selected.
173
        :param other_branch: A branch containing the other revision-id.  If
174
            not supplied, this.branch is used.
175
        :param base_branch: A branch containing the base revision-id.  If
176
            not supplied, other_branch or this.branch will be used.
177
        :param pb: A progress indicator
178
        """
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
179
        merger = Merger(this.branch, this_tree=this, pb=pb,
180
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
181
        if other_branch is None:
182
            other_branch = this.branch
183
        merger.set_other_revision(other, other_branch)
184
        if base is None:
185
            merger.find_base()
186
        else:
187
            if base_branch is None:
188
                base_branch = other_branch
189
            merger.set_base_revision(base, base_branch)
190
        return merger
191
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
192
    def revision_tree(self, revision_id, branch=None):
193
        if revision_id not in self._cached_trees:
194
            if branch is None:
195
                branch = self.this_branch
196
            try:
197
                tree = self.this_tree.revision_tree(revision_id)
198
            except errors.NoSuchRevisionInTree:
199
                tree = branch.repository.revision_tree(revision_id)
200
            self._cached_trees[revision_id] = tree
201
        return self._cached_trees[revision_id]
202
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
203
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
204
        from bzrlib import workingtree
205
        location, revno = treespec
206
        if revno is None:
207
            tree = workingtree.WorkingTree.open_containing(location)[0]
208
            return tree.branch, tree
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
209
        branch = Branch.open_containing(location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
210
        if revno == -1:
211
            revision_id = branch.last_revision()
212
        else:
213
            revision_id = branch.get_rev_id(revno)
214
        revision_id = ensure_null(revision_id)
215
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
216
217
    def ensure_revision_trees(self):
218
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
219
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
220
            if self.this_basis == self.this_rev_id:
221
                self.this_revision_tree = self.this_basis_tree
222
1185.12.83 by Aaron Bentley
Preliminary weave merge support
223
        if self.other_rev_id is None:
224
            other_basis_tree = self.revision_tree(self.other_basis)
1852.10.3 by Robert Collins
Remove all uses of compare_trees and replace with Tree.changes_from throughout bzrlib.
225
            changes = other_basis_tree.changes_from(self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
226
            if changes.has_changed():
227
                raise WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
228
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
229
            self.other_tree = other_basis_tree
230
231
    def file_revisions(self, file_id):
232
        self.ensure_revision_trees()
233
        def get_id(tree, file_id):
234
            revision_id = tree.inventory[file_id].revision
235
            assert revision_id is not None
236
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
237
        if self.this_rev_id is None:
238
            if self.this_basis_tree.get_file_sha1(file_id) != \
239
                self.this_tree.get_file_sha1(file_id):
240
                raise WorkingTreeNotRevision(self.this_tree)
241
242
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
243
        return [get_id(tree, file_id) for tree in trees]
244
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
245
    def check_basis(self, check_clean, require_commits=True):
246
        if self.this_basis is None and require_commits is True:
2249.3.1 by John Arbash Meinel
Mention using 'bzr pull' if there are no commits in current branch
247
            raise BzrCommandError("This branch has no commits."
248
                                  " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
249
        if check_clean:
250
            self.compare_basis()
251
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
252
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
253
254
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
255
        try:
256
            basis_tree = self.revision_tree(self.this_tree.last_revision())
257
        except errors.RevisionNotPresent:
258
            basis_tree = self.this_tree.basis_tree()
259
        changes = self.this_tree.changes_from(basis_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
260
        if not changes.has_changed():
261
            self.this_rev_id = self.this_basis
262
263
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
264
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
265
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
266
    def set_pending(self):
2644.1.1 by Wouter van Heyst
Fix bug #127115 by checking for self.other_rev_id being None in Merger.set_pending()
267
        if not self.base_is_ancestor or not self.base_is_other_ancestor or self.other_rev_id is None:
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
268
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
269
        self._add_parent()
270
271
    def _add_parent(self):
272
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
273
        new_parent_trees = []
274
        for revision_id in new_parents:
275
            try:
276
                tree = self.revision_tree(revision_id)
277
            except errors.RevisionNotPresent:
278
                tree = None
279
            else:
280
                tree.lock_read()
281
            new_parent_trees.append((revision_id, tree))
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
282
        try:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
283
            self.this_tree.set_parent_trees(new_parent_trees,
284
                                            allow_leftmost_as_ghost=True)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
285
        finally:
286
            for _revision_id, tree in new_parent_trees:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
287
                if tree is not None:
288
                    tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
289
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
290
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
291
        """Set the revision and tree to merge from.
292
293
        This sets the other_tree, other_rev_id, other_basis attributes.
294
295
        :param other_revision: The [path, revision] list to merge from.
296
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
297
        self.other_branch, self.other_tree = self._get_tree(other_revision,
298
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
299
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
300
            self.other_rev_id = _mod_revision.ensure_null(
301
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
302
            if _mod_revision.is_null(self.other_rev_id):
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
303
                raise NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
304
            self.other_basis = self.other_rev_id
305
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
306
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
307
            self.other_basis = self.other_rev_id
308
        else:
309
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
310
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
311
            if self.other_basis is None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
312
                raise NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
313
        if self.other_rev_id is not None:
314
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
315
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
316
2100.3.29 by Aaron Bentley
Get merge working initially
317
    def set_other_revision(self, revision_id, other_branch):
318
        """Set 'other' based on a branch and revision id
319
320
        :param revision_id: The revision to use for a tree
321
        :param other_branch: The branch containing this tree
322
        """
323
        self.other_rev_id = revision_id
324
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
325
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
326
        self.other_tree = self.revision_tree(revision_id)
327
        self.other_basis = revision_id
328
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
329
    def set_base_revision(self, revision_id, branch):
330
        """Set 'base' based on a branch and revision id
331
332
        :param revision_id: The revision to use for a tree
333
        :param branch: The branch containing this tree
334
        """
335
        self.base_rev_id = revision_id
336
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
337
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
338
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
339
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
340
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
341
        if not source.repository.has_same_location(target.repository):
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
342
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
343
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
344
    def find_base(self):
2590.2.22 by Aaron Bentley
Remove cruft
345
        revisions = [ensure_null(self.this_basis),
346
                     ensure_null(self.other_basis)]
347
        if NULL_REVISION in revisions:
348
            self.base_rev_id = NULL_REVISION
349
        else:
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
350
            self.base_rev_id, steps = self.revision_graph.find_unique_lca(
351
                revisions[0], revisions[1], count_steps=True)
2590.2.22 by Aaron Bentley
Remove cruft
352
            if self.base_rev_id == NULL_REVISION:
353
                raise UnrelatedBranches()
1551.19.10 by Aaron Bentley
Merge now warns when it encounters a criss-cross
354
            if steps > 1:
1551.19.11 by Aaron Bentley
Add criss-cross help topic
355
                warning('Warning: criss-cross merge encountered.  See bzr'
356
                        ' help criss-cross.')
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
357
        self.base_tree = self.revision_tree(self.base_rev_id)
358
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
359
        self.base_is_other_ancestor = True
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
360
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
361
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
362
        """Set the base revision to use for the merge.
363
364
        :param base_revision: A 2-list containing a path and revision number.
365
        """
1185.12.96 by Aaron Bentley
Merge from mpool
366
        mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
367
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
368
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
369
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
370
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
371
            if base_revision[1] == -1:
372
                self.base_rev_id = base_branch.last_revision()
373
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
374
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
375
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
376
                self.base_rev_id = _mod_revision.ensure_null(
377
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
378
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
379
3008.1.8 by Michael Hudson
extract merger creation into a method
380
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
381
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
382
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
383
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
384
                  'interesting_files': self.interesting_files,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
385
                  'pp': self.pp,
386
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
387
        if self.merge_type.requires_base:
388
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
389
        if self.merge_type.supports_reprocess:
390
            kwargs['reprocess'] = self.reprocess
391
        elif self.reprocess:
1551.6.14 by Aaron Bentley
Tweaks from merge review
392
            raise BzrError("Conflict reduction is not supported for merge"
393
                                  " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
394
        if self.merge_type.supports_show_base:
395
            kwargs['show_base'] = self.show_base
396
        elif self.show_base:
1534.8.2 by Aaron Bentley
Implemented weave merge
397
            raise BzrError("Showing base is not supported for this"
3008.1.14 by Michael Hudson
trivial commit for testing
398
                           " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
399
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
400
            and not self.base_is_other_ancestor):
401
            raise errors.CannotReverseCherrypick()
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
402
        if self.merge_type.history_based:
403
            kwargs['cherrypick'] = (not self.base_is_ancestor or
404
                                    not self.base_is_other_ancestor)
3008.1.8 by Michael Hudson
extract merger creation into a method
405
        return self.merge_type(pb=self._pb,
406
                               change_reporter=self.change_reporter,
407
                               **kwargs)
408
409
    def do_merge(self):
410
        merge = self.make_merger()
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
411
        self.this_tree.lock_tree_write()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
412
        if self.base_tree is not None:
413
            self.base_tree.lock_read()
414
        if self.other_tree is not None:
415
            self.other_tree.lock_read()
416
        try:
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
417
            merge.do_merge()
2255.2.226 by Robert Collins
Get merge_nested finally working: change nested tree iterators to take file_ids, and ensure the right branch is connected to in the merge logic. May not be suitable for shared repositories yet.
418
            if self.recurse == 'down':
419
                for path, file_id in self.this_tree.iter_references():
420
                    sub_tree = self.this_tree.get_nested_tree(file_id, path)
421
                    other_revision = self.other_tree.get_reference_revision(
422
                        file_id, path)
423
                    if  other_revision == sub_tree.last_revision():
424
                        continue
425
                    sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
426
                    sub_merge.merge_type = self.merge_type
427
                    relpath = self.this_tree.relpath(path)
428
                    other_branch = self.other_branch.reference_parent(file_id, relpath)
429
                    sub_merge.set_other_revision(other_revision, other_branch)
430
                    base_revision = self.base_tree.get_reference_revision(file_id)
431
                    sub_merge.base_tree = \
432
                        sub_tree.branch.repository.revision_tree(base_revision)
433
                    sub_merge.do_merge()
434
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
435
        finally:
436
            if self.other_tree is not None:
437
                self.other_tree.unlock()
438
            if self.base_tree is not None:
439
                self.base_tree.unlock()
440
            self.this_tree.unlock()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
441
        if len(merge.cooked_conflicts) == 0:
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
442
            if not self.ignore_zero and not is_quiet():
1534.7.141 by Aaron Bentley
Added conflict reporting
443
                note("All changes applied successfully.")
444
        else:
445
            note("%d conflicts encountered." % len(merge.cooked_conflicts))
446
1534.7.134 by Aaron Bentley
Hid raw conflicts
447
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
448
1545.2.4 by Aaron Bentley
PEP8 fixes
449
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
450
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
451
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
452
    requires_base = True
453
    supports_reprocess = True
454
    supports_show_base = True
455
    history_based = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
456
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
457
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
458
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
459
    def __init__(self, working_tree, this_tree, base_tree, other_tree, 
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
460
                 interesting_ids=None, reprocess=False, show_base=False,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
461
                 pb=DummyProgress(), pp=None, change_reporter=None,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
462
                 interesting_files=None, do_merge=True):
2590.2.10 by Aaron Bentley
Updates from review
463
        """Initialize the merger object and perform the merge.
464
465
        :param working_tree: The working tree to apply the merge to
466
        :param this_tree: The local tree in the merge operation
467
        :param base_tree: The common tree in the merge operation
468
        :param other_tree: The other other tree to merge changes from
469
        :param interesting_ids: The file_ids of files that should be
470
            participate in the merge.  May not be combined with
471
            interesting_files.
472
        :param: reprocess If True, perform conflict-reduction processing.
473
        :param show_base: If True, show the base revision in text conflicts.
474
            (incompatible with reprocess)
475
        :param pb: A Progress bar
476
        :param pp: A ProgressPhase object
477
        :param change_reporter: An object that should report changes made
478
        :param interesting_files: The tree-relative paths of files that should
479
            participate in the merge.  If these paths refer to directories,
480
            the contents of those directories will also be included.  May not
481
            be combined with interesting_ids.  If neither interesting_files nor
482
            interesting_ids is specified, all files may participate in the
483
            merge.
484
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
485
        object.__init__(self)
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
486
        if interesting_files is not None:
487
            assert interesting_ids is None
2590.2.4 by Aaron Bentley
Move entry generation to a helper
488
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
489
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
490
        self.this_tree = working_tree
491
        self.base_tree = base_tree
492
        self.other_tree = other_tree
493
        self._raw_conflicts = []
494
        self.cooked_conflicts = []
495
        self.reprocess = reprocess
496
        self.show_base = show_base
1534.9.1 by Aaron Bentley
Added progress bars to merge
497
        self.pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
498
        self.pp = pp
1551.11.9 by Aaron Bentley
Apply change reporting to merge
499
        self.change_reporter = change_reporter
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
500
        if self.pp is None:
501
            self.pp = ProgressPhase("Merge phase", 3, self.pb)
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
502
        if do_merge:
503
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
504
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
505
    def do_merge(self):
506
        self.this_tree.lock_tree_write()
507
        self.base_tree.lock_read()
508
        self.other_tree.lock_read()
509
        self.tt = TreeTransform(self.this_tree, self.pb)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
510
        try:
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
511
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
512
            self._compute_transform()
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
513
            self.pp.next_phase()
2590.2.17 by Aaron Bentley
Avoid redundant conflict check
514
            results = self.tt.apply(no_conflicts=True)
1558.4.3 by Aaron Bentley
Merge_modified performance/concurrency fix
515
            self.write_modified(results)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
516
            try:
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
517
                self.this_tree.add_conflicts(self.cooked_conflicts)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
518
            except UnsupportedOperation:
519
                pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
520
        finally:
1711.7.7 by John Arbash Meinel
Don't squelch errors in tt.finalize()
521
            self.tt.finalize()
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
522
            self.other_tree.unlock()
523
            self.base_tree.unlock()
524
            self.this_tree.unlock()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
525
            self.pb.clear()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
526
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
527
    def make_preview_transform(self):
528
        self.base_tree.lock_read()
529
        self.other_tree.lock_read()
530
        self.tt = TransformPreview(self.this_tree)
531
        try:
532
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
533
            self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
534
            self.pp.next_phase()
535
        finally:
536
            self.other_tree.unlock()
537
            self.base_tree.unlock()
538
            self.pb.clear()
539
        return self.tt
540
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
541
    def _compute_transform(self):
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
542
        entries = self._entries3()
543
        child_pb = ui.ui_factory.nested_progress_bar()
544
        try:
545
            for num, (file_id, changed, parents3, names3,
546
                      executable3) in enumerate(entries):
547
                child_pb.update('Preparing file merge', num, len(entries))
548
                self._merge_names(file_id, parents3, names3)
549
                if changed:
550
                    file_status = self.merge_contents(file_id)
551
                else:
552
                    file_status = 'unmodified'
553
                self._merge_executable(file_id,
554
                    executable3, file_status)
555
        finally:
556
            child_pb.finished()
557
        self.fix_root()
558
        self.pp.next_phase()
559
        child_pb = ui.ui_factory.nested_progress_bar()
560
        try:
561
            fs_conflicts = resolve_conflicts(self.tt, child_pb,
562
                lambda t, c: conflict_pass(t, c, self.other_tree))
563
        finally:
564
            child_pb.finished()
565
        if self.change_reporter is not None:
566
            from bzrlib import delta
567
            delta.report_changes(
568
                self.tt._iter_changes(), self.change_reporter)
569
        self.cook_conflicts(fs_conflicts)
570
        for conflict in self.cooked_conflicts:
571
            warning(conflict)
572
2590.2.4 by Aaron Bentley
Move entry generation to a helper
573
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
574
        """Gather data about files modified between three trees.
575
576
        Return a list of tuples of file_id, changed, parents3, names3,
577
        executable3.  changed is a boolean indicating whether the file contents
578
        or kind were changed.  parents3 is a tuple of parent ids for base,
579
        other and this.  names3 is a tuple of names for base, other and this.
580
        executable3 is a tuple of execute-bit values for base, other and this.
581
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
582
        result = []
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
583
        iterator = self.other_tree._iter_changes(self.base_tree,
584
                include_unchanged=True, specific_files=self.interesting_files,
585
                extra_trees=[self.this_tree])
2590.2.4 by Aaron Bentley
Move entry generation to a helper
586
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
587
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
588
            if (self.interesting_ids is not None and
589
                file_id not in self.interesting_ids):
590
                continue
591
            if file_id in self.this_tree.inventory:
592
                entry = self.this_tree.inventory[file_id]
593
                this_name = entry.name
594
                this_parent = entry.parent_id
595
                this_executable = entry.executable
596
            else:
597
                this_name = None
598
                this_parent = None
599
                this_executable = None
600
            parents3 = parents + (this_parent,)
601
            names3 = names + (this_name,)
602
            executable3 = executable + (this_executable,)
603
            result.append((file_id, changed, parents3, names3, executable3))
604
        return result
605
1731.1.33 by Aaron Bentley
Revert no-special-root changes
606
    def fix_root(self):
607
        try:
608
            self.tt.final_kind(self.tt.root)
609
        except NoSuchFile:
610
            self.tt.cancel_deletion(self.tt.root)
611
        if self.tt.final_file_id(self.tt.root) is None:
612
            self.tt.version_file(self.tt.tree_file_id(self.tt.root), 
613
                                 self.tt.root)
614
        if self.other_tree.inventory.root is None:
615
            return
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
616
        other_root_file_id = self.other_tree.get_root_id()
1731.1.33 by Aaron Bentley
Revert no-special-root changes
617
        other_root = self.tt.trans_id_file_id(other_root_file_id)
618
        if other_root == self.tt.root:
619
            return
620
        try:
621
            self.tt.final_kind(other_root)
622
        except NoSuchFile:
623
            return
624
        self.reparent_children(self.other_tree.inventory.root, self.tt.root)
625
        self.tt.cancel_creation(other_root)
626
        self.tt.cancel_versioning(other_root)
627
628
    def reparent_children(self, ie, target):
629
        for thing, child in ie.children.iteritems():
630
            trans_id = self.tt.trans_id_file_id(child.file_id)
631
            self.tt.adjust_path(self.tt.final_name(trans_id), target, trans_id)
632
1534.7.192 by Aaron Bentley
Record hashes produced by merges
633
    def write_modified(self, results):
634
        modified_hashes = {}
635
        for path in results.modified_paths:
636
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
637
            if file_id is None:
638
                continue
639
            hash = self.this_tree.get_file_sha1(file_id)
640
            if hash is None:
641
                continue
642
            modified_hashes[file_id] = hash
643
        self.this_tree.set_merge_modified(modified_hashes)
644
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
645
    @staticmethod
646
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
647
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
648
        if entry is None:
649
            return None
650
        return entry.parent_id
651
652
    @staticmethod
653
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
654
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
655
        if entry is None:
656
            return None
657
        return entry.name
658
    
659
    @staticmethod
660
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
661
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
662
        if file_id not in tree:
663
            return None
664
        return tree.get_file_sha1(file_id)
665
666
    @staticmethod
667
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
668
        """Determine the executability of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
669
        if file_id not in tree:
670
            return None
671
        if tree.kind(file_id) != "file":
672
            return False
673
        return tree.is_executable(file_id)
674
675
    @staticmethod
676
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
677
        """Determine the kind of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
678
        if file_id not in tree:
679
            return None
680
        return tree.kind(file_id)
681
682
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
683
    def _three_way(base, other, this):
684
        #if base == other, either they all agree, or only THIS has changed.
685
        if base == other:
686
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
687
        elif this not in (base, other):
2590.2.8 by Aaron Bentley
Restore conflict handling changes
688
            return 'conflict'
2590.2.10 by Aaron Bentley
Updates from review
689
        # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
690
        elif this == other:
691
            return "this"
2590.2.10 by Aaron Bentley
Updates from review
692
        # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
693
        else:
694
            return "other"
695
696
    @staticmethod
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
697
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
698
        """Do a three-way test on a scalar.
699
        Return "this", "other" or "conflict", depending whether a value wins.
700
        """
701
        key_base = key(base_tree, file_id)
702
        key_other = key(other_tree, file_id)
703
        #if base == other, either they all agree, or only THIS has changed.
704
        if key_base == key_other:
705
            return "this"
706
        key_this = key(this_tree, file_id)
707
        if key_this not in (key_base, key_other):
708
            return "conflict"
709
        # "Ambiguous clean merge"
710
        elif key_this == key_other:
711
            return "this"
712
        else:
713
            assert key_this == key_base
714
            return "other"
715
716
    def merge_names(self, file_id):
717
        def get_entry(tree):
718
            if file_id in tree.inventory:
719
                return tree.inventory[file_id]
720
            else:
721
                return None
722
        this_entry = get_entry(self.this_tree)
723
        other_entry = get_entry(self.other_tree)
724
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
725
        entries = (base_entry, other_entry, this_entry)
726
        names = []
727
        parents = []
728
        for entry in entries:
729
            if entry is None:
730
                names.append(None)
731
                parents.append(None)
732
            else:
733
                names.append(entry.name)
734
                parents.append(entry.parent_id)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
735
        return self._merge_names(file_id, parents, names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
736
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
737
    def _merge_names(self, file_id, parents, names):
2590.2.7 by Aaron Bentley
Misc cleanup
738
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
739
        base_name, other_name, this_name = names
740
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
741
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
742
        name_winner = self._three_way(*names)
743
744
        parent_id_winner = self._three_way(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
745
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
746
            if name_winner == "this":
747
                name_winner = "other"
748
            if parent_id_winner == "this":
749
                parent_id_winner = "other"
750
        if name_winner == "this" and parent_id_winner == "this":
751
            return
752
        if name_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
753
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
754
            self._raw_conflicts.append(('name conflict', trans_id, 
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
755
                                        this_name, other_name))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
756
        if parent_id_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
757
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
758
            self._raw_conflicts.append(('parent conflict', trans_id, 
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
759
                                        this_parent, other_parent))
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
760
        if other_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
761
            # it doesn't matter whether the result was 'other' or 
762
            # 'conflict'-- if there's no 'other', we leave it alone.
763
            return
764
        # if we get here, name_winner and parent_winner are set to safe values.
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
765
        trans_id = self.tt.trans_id_file_id(file_id)
2590.2.7 by Aaron Bentley
Misc cleanup
766
        parent_id = parents[self.winner_idx[parent_id_winner]]
1731.1.33 by Aaron Bentley
Revert no-special-root changes
767
        if parent_id is not None:
768
            parent_trans_id = self.tt.trans_id_file_id(parent_id)
2590.2.7 by Aaron Bentley
Misc cleanup
769
            self.tt.adjust_path(names[self.winner_idx[name_winner]],
1731.1.33 by Aaron Bentley
Revert no-special-root changes
770
                                parent_trans_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
771
772
    def merge_contents(self, file_id):
1534.7.157 by Aaron Bentley
Added more docs
773
        """Performa a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
774
        def contents_pair(tree):
775
            if file_id not in tree:
776
                return (None, None)
777
            kind = tree.kind(file_id)
778
            if kind == "file":
779
                contents = tree.get_file_sha1(file_id)
780
            elif kind == "symlink":
781
                contents = tree.get_symlink_target(file_id)
782
            else:
783
                contents = None
784
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
785
786
        def contents_conflict():
787
            trans_id = self.tt.trans_id_file_id(file_id)
788
            name = self.tt.final_name(trans_id)
789
            parent_id = self.tt.final_parent(trans_id)
790
            if file_id in self.this_tree.inventory:
791
                self.tt.unversion_file(trans_id)
1551.10.2 by Aaron Bentley
Handle merge with dangling inventory entries
792
                if file_id in self.this_tree:
793
                    self.tt.delete_contents(trans_id)
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
794
            file_group = self._dump_conflicts(name, parent_id, file_id, 
795
                                              set_version=True)
796
            self._raw_conflicts.append(('contents conflict', file_group))
797
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
798
        # See SPOT run.  run, SPOT, run.
799
        # So we're not QUITE repeating ourselves; we do tricky things with
800
        # file kind...
801
        base_pair = contents_pair(self.base_tree)
802
        other_pair = contents_pair(self.other_tree)
803
        if base_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
804
            # OTHER introduced no changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
805
            return "unmodified"
806
        this_pair = contents_pair(self.this_tree)
807
        if this_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
808
            # THIS and OTHER introduced the same changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
809
            return "unmodified"
810
        else:
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
811
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
812
            if this_pair == base_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
813
                # only OTHER introduced changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
814
                if file_id in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
815
                    # Remove any existing contents
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
816
                    self.tt.delete_contents(trans_id)
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
817
                if file_id in self.other_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
818
                    # OTHER changed the file
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
819
                    create_by_entry(self.tt, 
820
                                    self.other_tree.inventory[file_id], 
821
                                    self.other_tree, trans_id)
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
822
                    if file_id not in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
823
                        self.tt.version_file(file_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
824
                    return "modified"
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
825
                elif file_id in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
826
                    # OTHER deleted the file
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
827
                    self.tt.unversion_file(trans_id)
828
                    return "deleted"
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
829
            #BOTH THIS and OTHER introduced changes; scalar conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
830
            elif this_pair[0] == "file" and other_pair[0] == "file":
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
831
                # THIS and OTHER are both files, so text merge.  Either
832
                # BASE is a file, or both converted to files, so at least we
833
                # have agreement that output should be a file.
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
834
                try:
835
                    self.text_merge(file_id, trans_id)
836
                except BinaryFile:
837
                    return contents_conflict()
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
838
                if file_id not in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
839
                    self.tt.version_file(file_id, trans_id)
1534.7.152 by Aaron Bentley
Fixed overwrites
840
                try:
841
                    self.tt.tree_kind(trans_id)
842
                    self.tt.delete_contents(trans_id)
843
                except NoSuchFile:
844
                    pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
845
                return "modified"
846
            else:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
847
                # Scalar conflict, can't text merge.  Dump conflicts
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
848
                return contents_conflict()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
849
850
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
851
        """Return the lines in a file, or an empty list."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
852
        if file_id in tree:
853
            return tree.get_file(file_id).readlines()
854
        else:
855
            return []
856
857
    def text_merge(self, file_id, trans_id):
858
        """Perform a three-way text merge on a file_id"""
859
        # it's possible that we got here with base as a different type.
860
        # if so, we just want two-way text conflicts.
861
        if file_id in self.base_tree and \
862
            self.base_tree.kind(file_id) == "file":
863
            base_lines = self.get_lines(self.base_tree, file_id)
864
        else:
865
            base_lines = []
866
        other_lines = self.get_lines(self.other_tree, file_id)
867
        this_lines = self.get_lines(self.this_tree, file_id)
868
        m3 = Merge3(base_lines, this_lines, other_lines)
869
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
870
        if self.show_base is True:
871
            base_marker = '|' * 7
872
        else:
873
            base_marker = None
874
875
        def iter_merge3(retval):
876
            retval["text_conflicts"] = False
877
            for line in m3.merge_lines(name_a = "TREE", 
878
                                       name_b = "MERGE-SOURCE", 
879
                                       name_base = "BASE-REVISION",
880
                                       start_marker=start_marker, 
881
                                       base_marker=base_marker,
882
                                       reprocess=self.reprocess):
883
                if line.startswith(start_marker):
884
                    retval["text_conflicts"] = True
885
                    yield line.replace(start_marker, '<' * 7)
886
                else:
887
                    yield line
888
        retval = {}
889
        merge3_iterator = iter_merge3(retval)
890
        self.tt.create_file(merge3_iterator, trans_id)
891
        if retval["text_conflicts"] is True:
892
            self._raw_conflicts.append(('text conflict', trans_id))
893
            name = self.tt.final_name(trans_id)
894
            parent_id = self.tt.final_parent(trans_id)
895
            file_group = self._dump_conflicts(name, parent_id, file_id, 
896
                                              this_lines, base_lines,
897
                                              other_lines)
898
            file_group.append(trans_id)
899
900
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None, 
901
                        base_lines=None, other_lines=None, set_version=False,
902
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
903
        """Emit conflict files.
904
        If this_lines, base_lines, or other_lines are omitted, they will be
905
        determined automatically.  If set_version is true, the .OTHER, .THIS
906
        or .BASE (in that order) will be created as versioned files.
907
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
908
        data = [('OTHER', self.other_tree, other_lines), 
909
                ('THIS', self.this_tree, this_lines)]
910
        if not no_base:
911
            data.append(('BASE', self.base_tree, base_lines))
912
        versioned = False
913
        file_group = []
914
        for suffix, tree, lines in data:
915
            if file_id in tree:
916
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
917
                                               suffix, lines)
918
                file_group.append(trans_id)
919
                if set_version and not versioned:
920
                    self.tt.version_file(file_id, trans_id)
921
                    versioned = True
922
        return file_group
923
           
924
    def _conflict_file(self, name, parent_id, tree, file_id, suffix, 
925
                       lines=None):
1534.7.157 by Aaron Bentley
Added more docs
926
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
927
        name = name + '.' + suffix
928
        trans_id = self.tt.create_path(name, parent_id)
929
        entry = tree.inventory[file_id]
930
        create_by_entry(self.tt, entry, tree, trans_id, lines)
931
        return trans_id
932
933
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
934
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
935
        executable = [self.executable(t, file_id) for t in (self.base_tree,
936
                      self.other_tree, self.this_tree)]
937
        self._merge_executable(file_id, executable, file_status)
938
939
    def _merge_executable(self, file_id, executable, file_status):
940
        """Perform a merge on the execute bit."""
941
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
942
        if file_status == "deleted":
943
            return
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
944
        trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
945
        try:
946
            if self.tt.final_kind(trans_id) != "file":
947
                return
948
        except NoSuchFile:
949
            return
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
950
        winner = self._three_way(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
951
        if winner == "conflict":
952
        # There must be a None in here, if we have a conflict, but we
953
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
954
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
955
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
956
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
957
                winner = "other"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
958
        if winner == "this":
2325.3.4 by John Arbash Meinel
Rather than setting the executable bit for every file, properly create the working inventory to include it.
959
            if file_status == "modified":
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
960
                executability = this_executable
2325.3.4 by John Arbash Meinel
Rather than setting the executable bit for every file, properly create the working inventory to include it.
961
                if executability is not None:
962
                    trans_id = self.tt.trans_id_file_id(file_id)
963
                    self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
964
        else:
965
            assert winner == "other"
966
            if file_id in self.other_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
967
                executability = other_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
968
            elif file_id in self.this_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
969
                executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
970
            elif file_id in self.base_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
971
                executability = base_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
972
            if executability is not None:
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
973
                trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
974
                self.tt.set_executability(executability, trans_id)
975
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
976
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
977
        """Convert all conflicts into a form that doesn't depend on trans_id"""
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
978
        from conflicts import Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
979
        name_conflicts = {}
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
980
        self.cooked_conflicts.extend(cook_conflicts(fs_conflicts, self.tt))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
981
        fp = FinalPaths(self.tt)
982
        for conflict in self._raw_conflicts:
983
            conflict_type = conflict[0]
984
            if conflict_type in ('name conflict', 'parent conflict'):
985
                trans_id = conflict[1]
986
                conflict_args = conflict[2:]
987
                if trans_id not in name_conflicts:
988
                    name_conflicts[trans_id] = {}
989
                unique_add(name_conflicts[trans_id], conflict_type, 
990
                           conflict_args)
991
            if conflict_type == 'contents conflict':
992
                for trans_id in conflict[1]:
993
                    file_id = self.tt.final_file_id(trans_id)
994
                    if file_id is not None:
995
                        break
996
                path = fp.get_path(trans_id)
997
                for suffix in ('.BASE', '.THIS', '.OTHER'):
998
                    if path.endswith(suffix):
999
                        path = path[:-len(suffix)]
1000
                        break
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1001
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1002
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1003
            if conflict_type == 'text conflict':
1004
                trans_id = conflict[1]
1005
                path = fp.get_path(trans_id)
1006
                file_id = self.tt.final_file_id(trans_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1007
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1008
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1009
1010
        for trans_id, conflicts in name_conflicts.iteritems():
1011
            try:
1012
                this_parent, other_parent = conflicts['parent conflict']
1013
                assert this_parent != other_parent
1014
            except KeyError:
1015
                this_parent = other_parent = \
1016
                    self.tt.final_file_id(self.tt.final_parent(trans_id))
1017
            try:
1018
                this_name, other_name = conflicts['name conflict']
1019
                assert this_name != other_name
1020
            except KeyError:
1021
                this_name = other_name = self.tt.final_name(trans_id)
1022
            other_path = fp.get_path(trans_id)
1551.16.2 by Aaron Bentley
Don't crash on merging renamed deleted files (#110279)
1023
            if this_parent is not None and this_name is not None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1024
                this_parent_path = \
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1025
                    fp.get_path(self.tt.trans_id_file_id(this_parent))
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1026
                this_path = pathjoin(this_parent_path, this_name)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1027
            else:
1028
                this_path = "<deleted>"
1029
            file_id = self.tt.final_file_id(trans_id)
1534.10.20 by Aaron Bentley
Got all tests passing
1030
            c = Conflict.factory('path conflict', path=this_path,
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1031
                                 conflict_path=other_path, file_id=file_id)
1032
            self.cooked_conflicts.append(c)
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
1033
        self.cooked_conflicts.sort(key=Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1034
1035
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1036
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1037
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1038
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1039
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1040
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1041
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1042
1534.9.1 by Aaron Bentley
Added progress bars to merge
1043
    def __init__(self, working_tree, this_tree, base_tree, other_tree, 
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1044
                 interesting_ids=None, pb=DummyProgress(), pp=None,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1045
                 reprocess=False, change_reporter=None,
3008.1.16 by Aaron Bentley
Merge with bzr.dev
1046
                 interesting_files=None, cherrypick=False, do_merge=True):
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1047
        self.cherrypick = cherrypick
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1048
        super(WeaveMerger, self).__init__(working_tree, this_tree, 
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
1049
                                          base_tree, other_tree, 
1050
                                          interesting_ids=interesting_ids, 
1551.11.11 by Aaron Bentley
Get tests passing
1051
                                          pb=pb, pp=pp, reprocess=reprocess,
3008.1.16 by Aaron Bentley
Merge with bzr.dev
1052
                                          change_reporter=change_reporter,
1053
                                          do_merge=do_merge)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1054
1055
    def _merged_lines(self, file_id):
1056
        """Generate the merged lines.
1057
        There is no distinction between lines that are meant to contain <<<<<<<
1058
        and conflicts.
1059
        """
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1060
        if self.cherrypick:
1061
            base = self.base_tree
1062
        else:
1063
            base = None
3062.2.4 by Aaron Bentley
Start supporting merge-with-base
1064
        plan = self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1065
                                              base=base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1066
        if 'merge' in debug.debug_flags:
1067
            plan = list(plan)
1068
            trans_id = self.tt.trans_id_file_id(file_id)
1069
            name = self.tt.final_name(trans_id) + '.plan'
1070
            contents = ('%10s|%s' % l for l in plan)
1071
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1551.15.52 by Aaron Bentley
Tweak from review comments
1072
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1073
            '>>>>>>> MERGE-SOURCE\n')
1074
        return textmerge.merge_lines(self.reprocess)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1075
1076
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1077
        """Perform a (weave) text merge for a given file and file-id.
1078
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1079
        and a conflict will be noted.
1080
        """
1551.6.12 by Aaron Bentley
Indicate conflicts from merge_lines, insead of guessing
1081
        lines, conflicts = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1082
        lines = list(lines)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1083
        # Note we're checking whether the OUTPUT is binary in this case, 
1084
        # because we don't want to get into weave merge guts.
1085
        check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1086
        self.tt.create_file(lines, trans_id)
1087
        if conflicts:
1088
            self._raw_conflicts.append(('text conflict', trans_id))
1089
            name = self.tt.final_name(trans_id)
1090
            parent_id = self.tt.final_parent(trans_id)
1091
            file_group = self._dump_conflicts(name, parent_id, file_id, 
1092
                                              no_base=True)
1093
            file_group.append(trans_id)
1094
1095
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1096
class LCAMerger(WeaveMerger):
1097
1098
    def _merged_lines(self, file_id):
1099
        """Generate the merged lines.
1100
        There is no distinction between lines that are meant to contain <<<<<<<
1101
        and conflicts.
1102
        """
1103
        if self.cherrypick:
1104
            base = self.base_tree
1105
        else:
1106
            base = None
1107
        plan = self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
1108
                                                  base=base)
1109
        if 'merge' in debug.debug_flags:
1110
            plan = list(plan)
1111
            trans_id = self.tt.trans_id_file_id(file_id)
1112
            name = self.tt.final_name(trans_id) + '.plan'
1113
            contents = ('%10s|%s' % l for l in plan)
1114
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1115
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1116
            '>>>>>>> MERGE-SOURCE\n')
1117
        return textmerge.merge_lines(self.reprocess)
1118
1119
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1120
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1121
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1122
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1123
    def dump_file(self, temp_dir, name, tree, file_id):
1124
        out_path = pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1125
        out_file = open(out_path, "wb")
1126
        try:
1127
            in_file = tree.get_file(file_id)
1128
            for line in in_file:
1129
                out_file.write(line)
1130
        finally:
1131
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1132
        return out_path
1133
1134
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1135
        """Perform a diff3 merge using a specified file-id and trans-id.
1136
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1137
        will be dumped, and a will be conflict noted.
1138
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1139
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1140
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1141
        try:
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1142
            new_file = pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1143
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1144
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1145
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1146
            status = bzrlib.patch.diff3(new_file, this, base, other)
1147
            if status not in (0, 1):
1148
                raise BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1149
            f = open(new_file, 'rb')
1150
            try:
1151
                self.tt.create_file(f, trans_id)
1152
            finally:
1153
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1154
            if status == 1:
1155
                name = self.tt.final_name(trans_id)
1156
                parent_id = self.tt.final_parent(trans_id)
1157
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1158
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1159
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1160
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1161
1162
1163
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1164
                backup_files=False,
1165
                merge_type=Merge3Merger,
1166
                interesting_ids=None,
1167
                show_base=False,
1168
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1169
                other_rev_id=None,
1170
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1171
                this_tree=None,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1172
                pb=DummyProgress(),
1173
                change_reporter=None):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1174
    """Primary interface for merging. 
1175
1176
        typical use is probably 
1177
        'merge_inner(branch, branch.get_revision_tree(other_revision),
1178
                     branch.get_revision_tree(base_revision))'
1179
        """
1180
    if this_tree is None:
2367.2.1 by Robert Collins
Remove bzrlib 0.8 compatability where it was making the code unclear or messy. (Robert Collins)
1181
        raise BzrError("bzrlib.merge.merge_inner requires a this_tree "
1182
            "parameter as of bzrlib version 0.8.")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1183
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1184
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1185
    merger.backup_files = backup_files
1186
    merger.merge_type = merge_type
1187
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1188
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1189
    if interesting_files:
1190
        assert not interesting_ids, ('Only supply interesting_ids'
1191
                                     ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1192
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1193
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1194
    merger.reprocess = reprocess
1195
    merger.other_rev_id = other_rev_id
1196
    merger.other_basis = other_rev_id
1197
    return merger.do_merge()
1198
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1199
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1200
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1201
1202
    This method provides a sanctioned way to retrieve it.
1203
    """
1204
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1205
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1206
1207
1208
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1209
    def status_a(revision, text):
1210
        if revision in ancestors_b:
1211
            return 'killed-b', text
1212
        else:
1213
            return 'new-a', text
1214
1215
    def status_b(revision, text):
1216
        if revision in ancestors_a:
1217
            return 'killed-a', text
1218
        else:
1219
            return 'new-b', text
1220
1221
    plain_a = [t for (a, t) in annotated_a]
1222
    plain_b = [t for (a, t) in annotated_b]
1223
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1224
    blocks = matcher.get_matching_blocks()
1225
    a_cur = 0
1226
    b_cur = 0
1227
    for ai, bi, l in blocks:
1228
        # process all mismatched sections
1229
        # (last mismatched section is handled because blocks always
1230
        # includes a 0-length last block)
1231
        for revision, text in annotated_a[a_cur:ai]:
1232
            yield status_a(revision, text)
1233
        for revision, text in annotated_b[b_cur:bi]:
1234
            yield status_b(revision, text)
1235
1236
        # and now the matched section
1237
        a_cur = ai + l
1238
        b_cur = bi + l
1239
        for text_a, text_b in zip(plain_a[ai:a_cur], plain_b[bi:b_cur]):
1240
            assert text_a == text_b
1241
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1242
1243
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1244
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1245
1246
    def __init__(self, a_rev, b_rev, vf):
1247
        """Contructor.
1248
1249
        :param a_rev: Revision-id of one revision to merge
1250
        :param b_rev: Revision-id of the other revision to merge
1251
        :param vf: A versionedfile containing both revisions
1252
        """
1253
        self.a_rev = a_rev
1254
        self.b_rev = b_rev
1255
        self.lines_a = vf.get_lines(a_rev)
1256
        self.lines_b = vf.get_lines(b_rev)
1257
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
1258
        self._last_lines = None
1259
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
1260
        self._cached_matching_blocks = {}
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1261
1262
    def plan_merge(self):
1263
        """Generate a 'plan' for merging the two revisions.
1264
1265
        This involves comparing their texts and determining the cause of
1266
        differences.  If text A has a line and text B does not, then either the
1267
        line was added to text A, or it was deleted from B.  Once the causes
1268
        are combined, they are written out in the format described in
1269
        VersionedFile.plan_merge
1270
        """
1271
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1272
        unique_a, unique_b = self._unique_lines(blocks)
1273
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
1274
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
1275
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
1276
1277
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1278
        last_i = 0
1279
        last_j = 0
1280
        for i, j, n in blocks:
1281
            for a_index in range(last_i, i):
1282
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
1283
                    if a_index in killed_b:
1284
                        yield 'conflicted-a', self.lines_a[a_index]
1285
                    else:
1286
                        yield 'new-a', self.lines_a[a_index]
1287
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1288
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1289
            for b_index in range(last_j, j):
1290
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
1291
                    if b_index in killed_a:
1292
                        yield 'conflicted-b', self.lines_b[a_index]
1293
                    else:
1294
                        yield 'new-b', self.lines_b[b_index]
1295
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1296
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1297
            # handle common lines
1298
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1299
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1300
            last_i = i+n
1301
            last_j = j+n
1302
1303
    def _get_matching_blocks(self, left_revision, right_revision):
1304
        """Return a description of which sections of two revisions match.
1305
1306
        See SequenceMatcher.get_matching_blocks
1307
        """
3144.3.7 by Aaron Bentley
Update from review
1308
        cached = self._cached_matching_blocks.get((left_revision,
1309
                                                   right_revision))
1310
        if cached is not None:
1311
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
1312
        if self._last_lines_revision_id == left_revision:
1313
            left_lines = self._last_lines
1314
        else:
1315
            left_lines = self.vf.get_lines(left_revision)
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1316
        right_lines = self.vf.get_lines(right_revision)
3062.1.12 by Aaron Bentley
Implement simple text cache
1317
        self._last_lines = right_lines
1318
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1319
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
1320
                                                       right_lines)
1321
        return matcher.get_matching_blocks()
1322
1323
    def _unique_lines(self, matching_blocks):
1324
        """Analyse matching_blocks to determine which lines are unique
1325
1326
        :return: a tuple of (unique_left, unique_right), where the values are
1327
            sets of line numbers of unique lines.
1328
        """
1329
        last_i = 0
1330
        last_j = 0
1331
        unique_left = []
1332
        unique_right = []
1333
        for i, j, n in matching_blocks:
1334
            unique_left.extend(range(last_i, i))
1335
            unique_right.extend(range(last_j, j))
1336
            last_i = i + n
1337
            last_j = j + n
1338
        return unique_left, unique_right
1339
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1340
    @staticmethod
1341
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
1342
        """Remove changes from new_plan that came from old_plan.
1343
1344
        It is assumed that the difference between the old_plan and new_plan
1345
        is their choice of 'b' text.
1346
1347
        All lines from new_plan that differ from old_plan are emitted
1348
        verbatim.  All lines from new_plan that match old_plan but are
1349
        not about the 'b' revision are emitted verbatim.
1350
1351
        Lines that match and are about the 'b' revision are the lines we
1352
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
1353
        is skipped entirely.
1354
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1355
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
1356
                                                       new_plan)
1357
        last_j = 0
1358
        for i, j, n in matcher.get_matching_blocks():
1359
            for jj in range(last_j, j):
1360
                yield new_plan[jj]
1361
            for jj in range(j, j+n):
1362
                plan_line = new_plan[jj]
1363
                if plan_line[0] == 'new-b':
1364
                    pass
1365
                elif plan_line[0] == 'killed-b':
1366
                    yield 'unchanged', plan_line[1]
1367
                else:
1368
                    yield plan_line
1369
            last_j = j + n
1370
1371
1372
class _PlanMerge(_PlanMergeBase):
1373
    """Plan an annotate merge using on-the-fly annotation"""
1374
1375
    def __init__(self, a_rev, b_rev, vf):
1376
       _PlanMergeBase.__init__(self, a_rev, b_rev, vf)
1377
       a_ancestry = set(vf.get_ancestry(a_rev, topo_sorted=False))
1378
       b_ancestry = set(vf.get_ancestry(b_rev, topo_sorted=False))
1379
       self.uncommon = a_ancestry.symmetric_difference(b_ancestry)
1380
3144.3.7 by Aaron Bentley
Update from review
1381
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1382
        """Determines the status unique lines versus all lcas.
1383
1384
        Basically, determines why the line is unique to this revision.
1385
1386
        A line may be determined new or killed, but not both.
1387
3144.3.7 by Aaron Bentley
Update from review
1388
        :param revision_id: The id of the revision in which the lines are
1389
            unique
1390
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1391
        :return a tuple of (new_this, killed_other):
1392
        """
1393
        new = self._find_new(revision_id)
3144.3.7 by Aaron Bentley
Update from review
1394
        killed = set(unique_line_numbers).difference(new)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1395
        return new, killed
1396
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1397
    def _find_new(self, version_id):
1398
        """Determine which lines are new in the ancestry of this version.
1399
1400
        If a lines is present in this version, and not present in any
1401
        common ancestor, it is considered new.
1402
        """
1403
        if version_id not in self.uncommon:
1404
            return set()
1405
        parents = self.vf.get_parents(version_id)
1406
        if len(parents) == 0:
1407
            return set(range(len(self.vf.get_lines(version_id))))
1408
        new = None
1409
        for parent in parents:
1410
            blocks = self._get_matching_blocks(version_id, parent)
1411
            result, unused = self._unique_lines(blocks)
1412
            parent_new = self._find_new(parent)
1413
            for i, j, n in blocks:
1414
                for ii, jj in [(i+r, j+r) for r in range(n)]:
1415
                    if jj in parent_new:
1416
                        result.append(ii)
1417
            if new is None:
1418
                new = set(result)
1419
            else:
1420
                new.intersection_update(result)
1421
        return new
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
1422
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1423
1424
class _PlanLCAMerge(_PlanMergeBase):
1425
    """
3144.3.7 by Aaron Bentley
Update from review
1426
    This merge algorithm differs from _PlanMerge in that:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1427
    1. comparisons are done against LCAs only
1428
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
1429
       another are marked as conflicts, by emitting the line as conflicted-a
1430
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1431
1432
    This is faster, and hopefully produces more useful output.
1433
    """
1434
1435
    def __init__(self, a_rev, b_rev, vf, graph):
3144.3.7 by Aaron Bentley
Update from review
1436
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf)
1437
        self.lcas = graph.find_lca(a_rev, b_rev)
1438
        for lca in self.lcas:
1439
            lca_lines = self.vf.get_lines(lca)
1440
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
1441
                                                           lca_lines)
1442
            blocks = list(matcher.get_matching_blocks())
1443
            self._cached_matching_blocks[(a_rev, lca)] = blocks
1444
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
1445
                                                           lca_lines)
1446
            blocks = list(matcher.get_matching_blocks())
1447
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1448
3144.3.7 by Aaron Bentley
Update from review
1449
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1450
        """Determines the status unique lines versus all lcas.
1451
1452
        Basically, determines why the line is unique to this revision.
1453
1454
        A line may be determined new, killed, or both.
1455
3144.3.7 by Aaron Bentley
Update from review
1456
        If a line is determined new, that means it was not present in at least
1457
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1458
1459
        If a line is determined killed, that means the line was present in
1460
        at least one LCA.
1461
1462
        If a line is killed and new, this indicates that the two merge
1463
        revisions contain differing conflict resolutions.
3144.3.7 by Aaron Bentley
Update from review
1464
        :param revision_id: The id of the revision in which the lines are
1465
            unique
1466
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1467
        :return a tuple of (new_this, killed_other):
1468
        """
1469
        new = set()
1470
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
1471
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1472
        for lca in self.lcas:
1473
            blocks = self._get_matching_blocks(revision_id, lca)
1474
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
1475
            new.update(unique_line_numbers.intersection(unique_vs_lca))
1476
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1477
        return new, killed