/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1
# Copyright (C) 2005, 2006, 2008 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
17
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
18
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
19
from bzrlib import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
20
    branch as _mod_branch,
21
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
22
    debug,
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
23
    errors,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
24
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
25
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
26
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
27
    patiencediff,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
28
    progress,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
29
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
30
    textfile,
31
    trace,
32
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
33
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
34
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
35
    ui,
36
    versionedfile
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
37
    )
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
38
from bzrlib.symbol_versioning import (
39
    deprecated_in,
40
    deprecated_method,
41
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
42
# TODO: Report back as changes are merged in
43
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
44
1185.35.4 by Aaron Bentley
Implemented remerge
45
def transform_tree(from_tree, to_tree, interesting_ids=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
46
    from_tree.lock_tree_write()
47
    try:
48
        merge_inner(from_tree.branch, to_tree, from_tree, ignore_zero=True,
49
                    interesting_ids=interesting_ids, this_tree=from_tree)
50
    finally:
51
        from_tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
52
1457.1.12 by Robert Collins
Update comment to reflect author.
53
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
54
class Merger(object):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
55
    def __init__(self, this_branch, other_tree=None, base_tree=None,
1551.21.8 by Aaron Bentley
Remove now-redundant DummyProgress from Merger.__init__
56
                 this_tree=None, pb=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
57
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
58
        object.__init__(self)
59
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
60
        self.this_basis = _mod_revision.ensure_null(
61
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
62
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
63
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
64
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
65
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
66
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
67
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
68
        self.base_tree = base_tree
69
        self.ignore_zero = False
70
        self.backup_files = False
71
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
72
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
73
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
74
        self.reprocess = False
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
75
        if pb is not None:
76
            warnings.warn("pb parameter to Merger() is deprecated and ignored")
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
77
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
78
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
79
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
80
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
81
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
82
        self._base_is_ancestor = None
83
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
84
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
85
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
86
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
87
    def cache_trees_with_revision_ids(self, trees):
88
        """Cache any tree in trees if it has a revision_id."""
89
        for maybe_tree in trees:
90
            if maybe_tree is None:
91
                continue
92
            try:
93
                rev_id = maybe_tree.get_revision_id()
94
            except AttributeError:
95
                continue
96
            self._cached_trees[rev_id] = maybe_tree
97
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
98
    @property
99
    def revision_graph(self):
100
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
101
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
102
        return self._revision_graph
103
104
    def _set_base_is_ancestor(self, value):
105
        self._base_is_ancestor = value
106
107
    def _get_base_is_ancestor(self):
108
        if self._base_is_ancestor is None:
109
            self._base_is_ancestor = self.revision_graph.is_ancestor(
110
                self.base_rev_id, self.this_basis)
111
        return self._base_is_ancestor
112
113
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
114
115
    def _set_base_is_other_ancestor(self, value):
116
        self._base_is_other_ancestor = value
117
118
    def _get_base_is_other_ancestor(self):
119
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
120
            if self.other_basis is None:
121
                return True
122
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
123
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
124
        return self._base_is_other_ancestor
125
126
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
127
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
128
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
129
    @staticmethod
1551.21.7 by Aaron Bentley
Fix progress warning
130
    def from_uncommitted(tree, other_tree, pb=None, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
131
        """Return a Merger for uncommitted changes in other_tree.
132
133
        :param tree: The tree to merge into
134
        :param other_tree: The tree to get uncommitted changes from
135
        :param pb: A progress indicator
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
136
        :param base_tree: The basis to use for the merge.  If unspecified,
137
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
138
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
139
        if base_tree is None:
140
            base_tree = other_tree.basis_tree()
141
        merger = Merger(tree.branch, other_tree, base_tree, tree, pb)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
142
        merger.base_rev_id = merger.base_tree.get_revision_id()
143
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
144
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
145
        return merger
146
147
    @classmethod
148
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
149
        """Return a Merger for a bundle or merge directive.
150
151
        :param tree: The tree to merge changes into
152
        :param mergeable: A merge directive or bundle
153
        :param pb: A progress indicator
154
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
155
        mergeable.install_revisions(tree.branch.repository)
156
        base_revision_id, other_revision_id, verified =\
157
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
158
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
159
        if base_revision_id is not None:
160
            if (base_revision_id != _mod_revision.NULL_REVISION and
161
                revision_graph.is_ancestor(
162
                base_revision_id, tree.branch.last_revision())):
163
                base_revision_id = None
164
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
165
                trace.warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
166
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
167
                                         base_revision_id, revision_graph=
168
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
169
        return merger, verified
170
171
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
172
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
173
                          base_branch=None, revision_graph=None,
174
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
175
        """Return a Merger for revision-ids.
176
3363.17.15 by Aaron Bentley
Update docs
177
        :param pb: A progress indicator
1551.15.74 by Aaron Bentley
Textual updates from review
178
        :param tree: The tree to merge changes into
179
        :param other: The revision-id to use as OTHER
180
        :param base: The revision-id to use as BASE.  If not specified, will
181
            be auto-selected.
182
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
183
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
184
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
185
            not supplied, other_branch or tree.branch will be used.
186
        :param revision_graph: If you have a revision_graph precomputed, pass
187
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
188
        :param tree_branch: The branch associated with tree.  If not supplied,
189
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
190
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
191
        if tree_branch is None:
192
            tree_branch = tree.branch
193
        merger = Merger(tree_branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
194
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
195
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
196
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
197
        merger.set_other_revision(other, other_branch)
198
        if base is None:
199
            merger.find_base()
200
        else:
201
            if base_branch is None:
202
                base_branch = other_branch
203
            merger.set_base_revision(base, base_branch)
204
        return merger
205
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
206
    def revision_tree(self, revision_id, branch=None):
207
        if revision_id not in self._cached_trees:
208
            if branch is None:
209
                branch = self.this_branch
210
            try:
211
                tree = self.this_tree.revision_tree(revision_id)
212
            except errors.NoSuchRevisionInTree:
213
                tree = branch.repository.revision_tree(revision_id)
214
            self._cached_trees[revision_id] = tree
215
        return self._cached_trees[revision_id]
216
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
217
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
218
        from bzrlib import workingtree
219
        location, revno = treespec
220
        if revno is None:
221
            tree = workingtree.WorkingTree.open_containing(location)[0]
222
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
223
        branch = _mod_branch.Branch.open_containing(
224
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
225
        if revno == -1:
226
            revision_id = branch.last_revision()
227
        else:
228
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
229
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
230
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
231
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
232
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
233
    def ensure_revision_trees(self):
234
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
235
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
236
            if self.this_basis == self.this_rev_id:
237
                self.this_revision_tree = self.this_basis_tree
238
1185.12.83 by Aaron Bentley
Preliminary weave merge support
239
        if self.other_rev_id is None:
240
            other_basis_tree = self.revision_tree(self.other_basis)
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
241
            if other_basis_tree.has_changes(self.other_tree):
4869.2.1 by Andrew Bennetts
Trivial improvements to bzrlib/merge.py suggested by pyflakes.
242
                raise errors.WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
243
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
244
            self.other_tree = other_basis_tree
245
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
246
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
247
    def file_revisions(self, file_id):
248
        self.ensure_revision_trees()
249
        def get_id(tree, file_id):
250
            revision_id = tree.inventory[file_id].revision
251
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
252
        if self.this_rev_id is None:
253
            if self.this_basis_tree.get_file_sha1(file_id) != \
254
                self.this_tree.get_file_sha1(file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
255
                raise errors.WorkingTreeNotRevision(self.this_tree)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
256
257
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
258
        return [get_id(tree, file_id) for tree in trees]
259
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
260
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
261
    def check_basis(self, check_clean, require_commits=True):
262
        if self.this_basis is None and require_commits is True:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
263
            raise errors.BzrCommandError(
264
                "This branch has no commits."
265
                " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
266
        if check_clean:
267
            self.compare_basis()
268
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
269
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
270
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
271
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
272
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
273
        try:
274
            basis_tree = self.revision_tree(self.this_tree.last_revision())
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
275
        except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
276
            basis_tree = self.this_tree.basis_tree()
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
277
        if not self.this_tree.has_changes(basis_tree):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
278
            self.this_rev_id = self.this_basis
279
280
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
281
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
282
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
283
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
284
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
285
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
286
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
287
        self._add_parent()
288
289
    def _add_parent(self):
290
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
291
        new_parent_trees = []
292
        for revision_id in new_parents:
293
            try:
294
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
295
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
296
                tree = None
297
            else:
298
                tree.lock_read()
299
            new_parent_trees.append((revision_id, tree))
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
300
        try:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
301
            self.this_tree.set_parent_trees(new_parent_trees,
302
                                            allow_leftmost_as_ghost=True)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
303
        finally:
304
            for _revision_id, tree in new_parent_trees:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
305
                if tree is not None:
306
                    tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
307
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
308
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
309
        """Set the revision and tree to merge from.
310
311
        This sets the other_tree, other_rev_id, other_basis attributes.
312
313
        :param other_revision: The [path, revision] list to merge from.
314
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
315
        self.other_branch, self.other_tree = self._get_tree(other_revision,
316
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
317
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
318
            self.other_rev_id = _mod_revision.ensure_null(
319
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
320
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
321
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
322
            self.other_basis = self.other_rev_id
323
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
324
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
325
            self.other_basis = self.other_rev_id
326
        else:
327
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
328
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
329
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
330
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
331
        if self.other_rev_id is not None:
332
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
333
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
334
2100.3.29 by Aaron Bentley
Get merge working initially
335
    def set_other_revision(self, revision_id, other_branch):
336
        """Set 'other' based on a branch and revision id
337
338
        :param revision_id: The revision to use for a tree
339
        :param other_branch: The branch containing this tree
340
        """
341
        self.other_rev_id = revision_id
342
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
343
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
344
        self.other_tree = self.revision_tree(revision_id)
345
        self.other_basis = revision_id
346
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
347
    def set_base_revision(self, revision_id, branch):
348
        """Set 'base' based on a branch and revision id
349
350
        :param revision_id: The revision to use for a tree
351
        :param branch: The branch containing this tree
352
        """
353
        self.base_rev_id = revision_id
354
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
355
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
356
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
357
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
358
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
359
        if not source.repository.has_same_location(target.repository):
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
360
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
361
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
362
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
363
        revisions = [_mod_revision.ensure_null(self.this_basis),
364
                     _mod_revision.ensure_null(self.other_basis)]
365
        if _mod_revision.NULL_REVISION in revisions:
366
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
367
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
368
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
369
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
370
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
371
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
372
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
373
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
374
            elif len(lcas) == 1:
375
                self.base_rev_id = list(lcas)[0]
376
            else: # len(lcas) > 1
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
377
                if len(lcas) > 2:
378
                    # find_unique_lca can only handle 2 nodes, so we have to
379
                    # start back at the beginning. It is a shame to traverse
380
                    # the graph again, but better than re-implementing
381
                    # find_unique_lca.
382
                    self.base_rev_id = self.revision_graph.find_unique_lca(
383
                                            revisions[0], revisions[1])
384
                else:
385
                    self.base_rev_id = self.revision_graph.find_unique_lca(
386
                                            *lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
387
                self._is_criss_cross = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
388
            if self.base_rev_id == _mod_revision.NULL_REVISION:
389
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
390
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
391
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
392
                              ' help criss-cross.')
393
                trace.mutter('Criss-cross lcas: %r' % lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
394
                interesting_revision_ids = [self.base_rev_id]
395
                interesting_revision_ids.extend(lcas)
396
                interesting_trees = dict((t.get_revision_id(), t)
397
                    for t in self.this_branch.repository.revision_trees(
398
                        interesting_revision_ids))
399
                self._cached_trees.update(interesting_trees)
400
                self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
401
                sorted_lca_keys = self.revision_graph.find_merge_order(
402
                    revisions[0], lcas)
403
                self._lca_trees = [interesting_trees[key]
404
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
405
            else:
406
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
407
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
408
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
409
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
410
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
411
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
412
        """Set the base revision to use for the merge.
413
414
        :param base_revision: A 2-list containing a path and revision number.
415
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
416
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
417
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
418
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
419
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
420
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
421
            if base_revision[1] == -1:
422
                self.base_rev_id = base_branch.last_revision()
423
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
424
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
425
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
426
                self.base_rev_id = _mod_revision.ensure_null(
427
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
428
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
429
3008.1.8 by Michael Hudson
extract merger creation into a method
430
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
431
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
432
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
433
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
434
                  'interesting_files': self.interesting_files,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
435
                  'pp': self.pp,
436
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
437
        if self.merge_type.requires_base:
438
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
439
        if self.merge_type.supports_reprocess:
440
            kwargs['reprocess'] = self.reprocess
441
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
442
            raise errors.BzrError(
443
                "Conflict reduction is not supported for merge"
444
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
445
        if self.merge_type.supports_show_base:
446
            kwargs['show_base'] = self.show_base
447
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
448
            raise errors.BzrError("Showing base is not supported for this"
449
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
450
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
451
            and not self.base_is_other_ancestor):
452
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
453
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
454
            kwargs['cherrypick'] = (not self.base_is_ancestor or
455
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
456
        if self._is_criss_cross and getattr(self.merge_type,
457
                                            'supports_lca_trees', False):
458
            kwargs['lca_trees'] = self._lca_trees
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
459
        return self.merge_type(pb=None,
3008.1.8 by Michael Hudson
extract merger creation into a method
460
                               change_reporter=self.change_reporter,
461
                               **kwargs)
462
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
463
    def _do_merge_to(self, merge):
4273.1.9 by Aaron Bentley
Cleanup
464
        if self.other_branch is not None:
465
            self.other_branch.update_references(self.this_branch)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
466
        merge.do_merge()
467
        if self.recurse == 'down':
468
            for relpath, file_id in self.this_tree.iter_references():
469
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
470
                other_revision = self.other_tree.get_reference_revision(
471
                    file_id, relpath)
472
                if  other_revision == sub_tree.last_revision():
473
                    continue
474
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
475
                sub_merge.merge_type = self.merge_type
476
                other_branch = self.other_branch.reference_parent(file_id, relpath)
477
                sub_merge.set_other_revision(other_revision, other_branch)
478
                base_revision = self.base_tree.get_reference_revision(file_id)
479
                sub_merge.base_tree = \
480
                    sub_tree.branch.repository.revision_tree(base_revision)
481
                sub_merge.base_rev_id = base_revision
482
                sub_merge.do_merge()
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
483
3008.1.8 by Michael Hudson
extract merger creation into a method
484
    def do_merge(self):
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
485
        self.this_tree.lock_tree_write()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
486
        try:
487
            if self.base_tree is not None:
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
488
                self.base_tree.lock_read()
489
            try:
490
                if self.other_tree is not None:
491
                    self.other_tree.lock_read()
492
                try:
493
                    merge = self.make_merger()
494
                    self._do_merge_to(merge)
495
                finally:
496
                    if self.other_tree is not None:
497
                        self.other_tree.unlock()
498
            finally:
499
                if self.base_tree is not None:
500
                    self.base_tree.unlock()
501
        finally:
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
502
            self.this_tree.unlock()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
503
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
504
            if not self.ignore_zero and not trace.is_quiet():
505
                trace.note("All changes applied successfully.")
1534.7.141 by Aaron Bentley
Added conflict reporting
506
        else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
507
            trace.note("%d conflicts encountered."
508
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
509
1534.7.134 by Aaron Bentley
Hid raw conflicts
510
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
511
1545.2.4 by Aaron Bentley
PEP8 fixes
512
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
513
class _InventoryNoneEntry(object):
514
    """This represents an inventory entry which *isn't there*.
515
516
    It simplifies the merging logic if we always have an InventoryEntry, even
517
    if it isn't actually present
518
    """
519
    executable = None
520
    kind = None
521
    name = None
522
    parent_id = None
523
    revision = None
524
    symlink_target = None
525
    text_sha1 = None
526
527
_none_entry = _InventoryNoneEntry()
528
529
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
530
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
531
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
532
    requires_base = True
533
    supports_reprocess = True
534
    supports_show_base = True
535
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
536
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
537
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
538
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
539
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
540
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
541
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
542
                 interesting_ids=None, reprocess=False, show_base=False,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
543
                 pb=None, pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
544
                 interesting_files=None, do_merge=True,
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
545
                 cherrypick=False, lca_trees=None):
2590.2.10 by Aaron Bentley
Updates from review
546
        """Initialize the merger object and perform the merge.
547
548
        :param working_tree: The working tree to apply the merge to
549
        :param this_tree: The local tree in the merge operation
550
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
551
        :param other_tree: The other tree to merge changes from
2590.2.10 by Aaron Bentley
Updates from review
552
        :param interesting_ids: The file_ids of files that should be
553
            participate in the merge.  May not be combined with
554
            interesting_files.
555
        :param: reprocess If True, perform conflict-reduction processing.
556
        :param show_base: If True, show the base revision in text conflicts.
557
            (incompatible with reprocess)
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
558
        :param pb: ignored
2590.2.10 by Aaron Bentley
Updates from review
559
        :param pp: A ProgressPhase object
560
        :param change_reporter: An object that should report changes made
561
        :param interesting_files: The tree-relative paths of files that should
562
            participate in the merge.  If these paths refer to directories,
563
            the contents of those directories will also be included.  May not
564
            be combined with interesting_ids.  If neither interesting_files nor
565
            interesting_ids is specified, all files may participate in the
566
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
567
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
568
            if the ancestry was found to include a criss-cross merge.
569
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
570
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
571
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
572
        if interesting_files is not None and interesting_ids is not None:
573
            raise ValueError(
574
                'specify either interesting_ids or interesting_files')
2590.2.4 by Aaron Bentley
Move entry generation to a helper
575
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
576
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
577
        self.this_tree = working_tree
578
        self.base_tree = base_tree
579
        self.other_tree = other_tree
580
        self._raw_conflicts = []
581
        self.cooked_conflicts = []
582
        self.reprocess = reprocess
583
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
584
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
585
        # Uncommenting this will change the default algorithm to always use
586
        # _entries_lca. This can be useful for running the test suite and
587
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
588
        # if lca_trees is None:
589
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
590
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
591
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
592
        if do_merge:
593
            self.do_merge()
4961.2.12 by Martin Pool
Further pb/pp removals
594
        if pp is not None:
595
            warnings.warn("pp argument to Merge3Merger is deprecated")
596
        if pb is not None:
597
            warnings.warn("pb argument to Merge3Merger is deprecated")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
598
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
599
    def do_merge(self):
600
        self.this_tree.lock_tree_write()
601
        self.base_tree.lock_read()
602
        self.other_tree.lock_read()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
603
        try:
4961.2.12 by Martin Pool
Further pb/pp removals
604
            self.tt = transform.TreeTransform(self.this_tree, None)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
605
            try:
4684.1.2 by Gary van der Merwe
In merger, make sure that we unlock the trees if we fail to create a TreeTransform object.
606
                self._compute_transform()
607
                results = self.tt.apply(no_conflicts=True)
608
                self.write_modified(results)
609
                try:
610
                    self.this_tree.add_conflicts(self.cooked_conflicts)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
611
                except errors.UnsupportedOperation:
4684.1.2 by Gary van der Merwe
In merger, make sure that we unlock the trees if we fail to create a TreeTransform object.
612
                    pass
613
            finally:
614
                self.tt.finalize()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
615
        finally:
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
616
            self.other_tree.unlock()
617
            self.base_tree.unlock()
618
            self.this_tree.unlock()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
619
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
620
    def make_preview_transform(self):
621
        self.base_tree.lock_read()
622
        self.other_tree.lock_read()
4721.3.1 by Vincent Ladeuil
Cleanup imports.
623
        self.tt = transform.TransformPreview(self.this_tree)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
624
        try:
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
625
            self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
626
        finally:
627
            self.other_tree.unlock()
628
            self.base_tree.unlock()
629
        return self.tt
630
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
631
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
632
        if self._lca_trees is None:
633
            entries = self._entries3()
634
            resolver = self._three_way
635
        else:
636
            entries = self._entries_lca()
637
            resolver = self._lca_multi_way
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
638
        child_pb = ui.ui_factory.nested_progress_bar()
639
        try:
640
            for num, (file_id, changed, parents3, names3,
641
                      executable3) in enumerate(entries):
642
                child_pb.update('Preparing file merge', num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
643
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
644
                if changed:
645
                    file_status = self.merge_contents(file_id)
646
                else:
647
                    file_status = 'unmodified'
648
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
649
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
650
        finally:
651
            child_pb.finished()
652
        self.fix_root()
653
        child_pb = ui.ui_factory.nested_progress_bar()
654
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
655
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
656
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
657
        finally:
658
            child_pb.finished()
659
        if self.change_reporter is not None:
660
            from bzrlib import delta
661
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
662
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
663
        self.cook_conflicts(fs_conflicts)
664
        for conflict in self.cooked_conflicts:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
665
            trace.warning(conflict)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
666
2590.2.4 by Aaron Bentley
Move entry generation to a helper
667
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
668
        """Gather data about files modified between three trees.
669
670
        Return a list of tuples of file_id, changed, parents3, names3,
671
        executable3.  changed is a boolean indicating whether the file contents
672
        or kind were changed.  parents3 is a tuple of parent ids for base,
673
        other and this.  names3 is a tuple of names for base, other and this.
674
        executable3 is a tuple of execute-bit values for base, other and this.
675
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
676
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
677
        iterator = self.other_tree.iter_changes(self.base_tree,
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
678
                include_unchanged=True, specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
679
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
680
        this_entries = dict((e.file_id, e) for p, e in
681
                            self.this_tree.iter_entries_by_dir(
682
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
683
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
684
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
685
            if (self.interesting_ids is not None and
686
                file_id not in self.interesting_ids):
687
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
688
            entry = this_entries.get(file_id)
689
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
690
                this_name = entry.name
691
                this_parent = entry.parent_id
692
                this_executable = entry.executable
693
            else:
694
                this_name = None
695
                this_parent = None
696
                this_executable = None
697
            parents3 = parents + (this_parent,)
698
            names3 = names + (this_name,)
699
            executable3 = executable + (this_executable,)
700
            result.append((file_id, changed, parents3, names3, executable3))
701
        return result
702
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
703
    def _entries_lca(self):
704
        """Gather data about files modified between multiple trees.
705
706
        This compares OTHER versus all LCA trees, and for interesting entries,
707
        it then compares with THIS and BASE.
708
709
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
710
        :return: [(file_id, changed, parents, names, executable)]
711
            file_id     Simple file_id of the entry
712
            changed     Boolean, True if the kind or contents changed
713
                        else False
714
            parents     ((base, [parent_id, in, lcas]), parent_id_other,
715
                         parent_id_this)
716
            names       ((base, [name, in, lcas]), name_in_other, name_in_this)
717
            executable  ((base, [exec, in, lcas]), exec_in_other, exec_in_this)
718
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
719
        if self.interesting_files is not None:
720
            lookup_trees = [self.this_tree, self.base_tree]
721
            lookup_trees.extend(self._lca_trees)
722
            # I think we should include the lca trees as well
723
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
724
                                                        lookup_trees)
725
        else:
726
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
727
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
728
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
729
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
730
        base_inventory = self.base_tree.inventory
731
        this_inventory = self.this_tree.inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
732
        for path, file_id, other_ie, lca_values in walker.iter_all():
733
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
734
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
735
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
736
            if interesting_ids is not None and file_id not in interesting_ids:
737
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
738
3514.4.30 by John Arbash Meinel
Several updates.
739
            # If other_revision is found in any of the lcas, that means this
740
            # node is uninteresting. This is because when merging, if there are
741
            # multiple heads(), we have to create a new node. So if we didn't,
742
            # we know that the ancestry is linear, and that OTHER did not
743
            # modify anything
744
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
745
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
746
            if other_revision is not None:
747
                # We can't use this shortcut when other_revision is None,
748
                # because it may be None because things are WorkingTrees, and
749
                # not because it is *actually* None.
750
                is_unmodified = False
751
                for lca_path, ie in lca_values:
752
                    if ie is not None and ie.revision == other_revision:
753
                        is_unmodified = True
754
                        break
755
                if is_unmodified:
756
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
757
758
            lca_entries = []
759
            for lca_path, lca_ie in lca_values:
760
                if lca_ie is None:
761
                    lca_entries.append(_none_entry)
762
                else:
763
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
764
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
765
            if file_id in base_inventory:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
766
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
767
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
768
                base_ie = _none_entry
769
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
770
            if file_id in this_inventory:
771
                this_ie = this_inventory[file_id]
772
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
773
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
774
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
775
            lca_kinds = []
776
            lca_parent_ids = []
777
            lca_names = []
778
            lca_executable = []
779
            for lca_ie in lca_entries:
780
                lca_kinds.append(lca_ie.kind)
781
                lca_parent_ids.append(lca_ie.parent_id)
782
                lca_names.append(lca_ie.name)
783
                lca_executable.append(lca_ie.executable)
784
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
785
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
786
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
787
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
788
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
789
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
790
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
791
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
792
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
793
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
794
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
795
            content_changed = True
796
            if kind_winner == 'this':
797
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
798
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
799
                    if parent_id_winner == 'this' and name_winner == 'this':
800
                        # No change for this directory in OTHER, skip
801
                        continue
802
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
803
                elif other_ie.kind is None or other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
804
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
805
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
806
                            return None
807
                        return tree.get_file_sha1(file_id)
808
                    base_sha1 = get_sha1(base_ie, self.base_tree)
809
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
810
                                 in zip(lca_entries, self._lca_trees)]
811
                    this_sha1 = get_sha1(this_ie, self.this_tree)
812
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
813
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
814
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
815
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
816
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
817
                        (base_ie.executable, lca_executable),
818
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
819
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
820
                        and sha1_winner == 'this' and exec_winner == 'this'):
821
                        # No kind, parent, name, exec, or content change for
822
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
823
                        continue
824
                    if sha1_winner == 'this':
825
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
826
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
827
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
828
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
829
                            return None
830
                        return tree.get_symlink_target(file_id)
831
                    base_target = get_target(base_ie, self.base_tree)
832
                    lca_targets = [get_target(ie, tree) for ie, tree
833
                                   in zip(lca_entries, self._lca_trees)]
834
                    this_target = get_target(this_ie, self.this_tree)
835
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
836
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
837
                        (base_target, lca_targets),
838
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
839
                    if (parent_id_winner == 'this' and name_winner == 'this'
840
                        and target_winner == 'this'):
841
                        # No kind, parent, name, or symlink target change
842
                        # not interesting
843
                        continue
844
                    if target_winner == 'this':
845
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
846
                elif other_ie.kind == 'tree-reference':
847
                    # The 'changed' information seems to be handled at a higher
848
                    # level. At least, _entries3 returns False for content
849
                    # changed, even when at a new revision_id.
850
                    content_changed = False
851
                    if (parent_id_winner == 'this' and name_winner == 'this'):
852
                        # Nothing interesting
853
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
854
                else:
855
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
856
                # XXX: We need to handle kind == 'symlink'
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
857
858
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
859
            result.append((file_id, content_changed,
860
                           ((base_ie.parent_id, lca_parent_ids),
861
                            other_ie.parent_id, this_ie.parent_id),
862
                           ((base_ie.name, lca_names),
863
                            other_ie.name, this_ie.name),
864
                           ((base_ie.executable, lca_executable),
865
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
866
                          ))
867
        return result
868
869
1731.1.33 by Aaron Bentley
Revert no-special-root changes
870
    def fix_root(self):
871
        try:
872
            self.tt.final_kind(self.tt.root)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
873
        except errors.NoSuchFile:
1731.1.33 by Aaron Bentley
Revert no-special-root changes
874
            self.tt.cancel_deletion(self.tt.root)
875
        if self.tt.final_file_id(self.tt.root) is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
876
            self.tt.version_file(self.tt.tree_file_id(self.tt.root),
1731.1.33 by Aaron Bentley
Revert no-special-root changes
877
                                 self.tt.root)
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
878
        other_root_file_id = self.other_tree.get_root_id()
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
879
        if other_root_file_id is None:
880
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
881
        other_root = self.tt.trans_id_file_id(other_root_file_id)
882
        if other_root == self.tt.root:
883
            return
884
        try:
885
            self.tt.final_kind(other_root)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
886
        except errors.NoSuchFile:
1731.1.33 by Aaron Bentley
Revert no-special-root changes
887
            return
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
888
        if self.other_tree.inventory.root.file_id in self.this_tree.inventory:
889
            # the other tree's root is a non-root in the current tree
890
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
891
        self.reparent_children(self.other_tree.inventory.root, self.tt.root)
892
        self.tt.cancel_creation(other_root)
893
        self.tt.cancel_versioning(other_root)
894
895
    def reparent_children(self, ie, target):
896
        for thing, child in ie.children.iteritems():
897
            trans_id = self.tt.trans_id_file_id(child.file_id)
898
            self.tt.adjust_path(self.tt.final_name(trans_id), target, trans_id)
899
1534.7.192 by Aaron Bentley
Record hashes produced by merges
900
    def write_modified(self, results):
901
        modified_hashes = {}
902
        for path in results.modified_paths:
903
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
904
            if file_id is None:
905
                continue
906
            hash = self.this_tree.get_file_sha1(file_id)
907
            if hash is None:
908
                continue
909
            modified_hashes[file_id] = hash
910
        self.this_tree.set_merge_modified(modified_hashes)
911
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
912
    @staticmethod
913
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
914
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
915
        if entry is None:
916
            return None
917
        return entry.parent_id
918
919
    @staticmethod
920
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
921
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
922
        if entry is None:
923
            return None
924
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
925
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
926
    @staticmethod
927
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
928
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
929
        if file_id not in tree:
930
            return None
931
        return tree.get_file_sha1(file_id)
932
933
    @staticmethod
934
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
935
        """Determine the executability of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
936
        if file_id not in tree:
937
            return None
938
        if tree.kind(file_id) != "file":
939
            return False
940
        return tree.is_executable(file_id)
941
942
    @staticmethod
943
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
944
        """Determine the kind of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
945
        if file_id not in tree:
946
            return None
947
        return tree.kind(file_id)
948
949
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
950
    def _three_way(base, other, this):
951
        #if base == other, either they all agree, or only THIS has changed.
952
        if base == other:
953
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
954
        elif this not in (base, other):
2590.2.8 by Aaron Bentley
Restore conflict handling changes
955
            return 'conflict'
2590.2.10 by Aaron Bentley
Updates from review
956
        # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
957
        elif this == other:
958
            return "this"
2590.2.10 by Aaron Bentley
Updates from review
959
        # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
960
        else:
961
            return "other"
962
963
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
964
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
965
        """Consider LCAs when determining whether a change has occurred.
966
967
        If LCAS are all identical, this is the same as a _three_way comparison.
968
969
        :param bases: value in (BASE, [LCAS])
970
        :param other: value in OTHER
971
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
972
        :param allow_overriding_lca: If there is more than one unique lca
973
            value, allow OTHER to override THIS if it has a new value, and
974
            THIS only has an lca value, or vice versa. This is appropriate for
975
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
976
        :return: 'this', 'other', or 'conflict' depending on whether an entry
977
            changed or not.
978
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
979
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
980
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
981
        if other == this:
982
            # Either Ambiguously clean, or nothing was actually changed. We
983
            # don't really care
984
            return 'this'
985
        base_val, lca_vals = bases
986
        # Remove 'base_val' from the lca_vals, because it is not interesting
987
        filtered_lca_vals = [lca_val for lca_val in lca_vals
988
                                      if lca_val != base_val]
989
        if len(filtered_lca_vals) == 0:
990
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
991
992
        unique_lca_vals = set(filtered_lca_vals)
993
        if len(unique_lca_vals) == 1:
994
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
995
996
        if allow_overriding_lca:
997
            if other in unique_lca_vals:
998
                if this in unique_lca_vals:
999
                    # Each side picked a different lca, conflict
1000
                    return 'conflict'
1001
                else:
1002
                    # This has a value which supersedes both lca values, and
1003
                    # other only has an lca value
1004
                    return 'this'
1005
            elif this in unique_lca_vals:
1006
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1007
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1008
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1009
1010
        # At this point, the lcas disagree, and the tips disagree
1011
        return 'conflict'
1012
1013
    @staticmethod
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1014
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
1015
        """Do a three-way test on a scalar.
1016
        Return "this", "other" or "conflict", depending whether a value wins.
1017
        """
1018
        key_base = key(base_tree, file_id)
1019
        key_other = key(other_tree, file_id)
1020
        #if base == other, either they all agree, or only THIS has changed.
1021
        if key_base == key_other:
1022
            return "this"
1023
        key_this = key(this_tree, file_id)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1024
        # "Ambiguous clean merge"
1025
        if key_this == key_other:
1026
            return "this"
1027
        elif key_this == key_base:
1028
            return "other"
1029
        else:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1030
            return "conflict"
1031
1032
    def merge_names(self, file_id):
1033
        def get_entry(tree):
1034
            if file_id in tree.inventory:
1035
                return tree.inventory[file_id]
1036
            else:
1037
                return None
1038
        this_entry = get_entry(self.this_tree)
1039
        other_entry = get_entry(self.other_tree)
1040
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1041
        entries = (base_entry, other_entry, this_entry)
1042
        names = []
1043
        parents = []
1044
        for entry in entries:
1045
            if entry is None:
1046
                names.append(None)
1047
                parents.append(None)
1048
            else:
1049
                names.append(entry.name)
1050
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1051
        return self._merge_names(file_id, parents, names,
1052
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1053
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1054
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1055
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1056
        base_name, other_name, this_name = names
1057
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1058
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1059
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1060
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1061
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1062
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1063
            if name_winner == "this":
1064
                name_winner = "other"
1065
            if parent_id_winner == "this":
1066
                parent_id_winner = "other"
1067
        if name_winner == "this" and parent_id_winner == "this":
1068
            return
1069
        if name_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1070
            trans_id = self.tt.trans_id_file_id(file_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1071
            self._raw_conflicts.append(('name conflict', trans_id,
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1072
                                        this_name, other_name))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1073
        if parent_id_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1074
            trans_id = self.tt.trans_id_file_id(file_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1075
            self._raw_conflicts.append(('parent conflict', trans_id,
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1076
                                        this_parent, other_parent))
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1077
        if other_name is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1078
            # it doesn't matter whether the result was 'other' or
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1079
            # 'conflict'-- if there's no 'other', we leave it alone.
1080
            return
1081
        # if we get here, name_winner and parent_winner are set to safe values.
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1082
        trans_id = self.tt.trans_id_file_id(file_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1083
        parent_id = parents[self.winner_idx[parent_id_winner]]
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1084
        if parent_id is not None:
1085
            parent_trans_id = self.tt.trans_id_file_id(parent_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1086
            self.tt.adjust_path(names[self.winner_idx[name_winner]],
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1087
                                parent_trans_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1088
1089
    def merge_contents(self, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1090
        """Performs a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1091
        def contents_pair(tree):
1092
            if file_id not in tree:
1093
                return (None, None)
1094
            kind = tree.kind(file_id)
1095
            if kind == "file":
1096
                contents = tree.get_file_sha1(file_id)
1097
            elif kind == "symlink":
1098
                contents = tree.get_symlink_target(file_id)
1099
            else:
1100
                contents = None
1101
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1102
1103
        def contents_conflict():
1104
            trans_id = self.tt.trans_id_file_id(file_id)
1105
            name = self.tt.final_name(trans_id)
1106
            parent_id = self.tt.final_parent(trans_id)
1107
            if file_id in self.this_tree.inventory:
1108
                self.tt.unversion_file(trans_id)
1551.10.2 by Aaron Bentley
Handle merge with dangling inventory entries
1109
                if file_id in self.this_tree:
1110
                    self.tt.delete_contents(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1111
            file_group = self._dump_conflicts(name, parent_id, file_id,
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1112
                                              set_version=True)
1113
            self._raw_conflicts.append(('contents conflict', file_group))
1114
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1115
        # See SPOT run.  run, SPOT, run.
1116
        # So we're not QUITE repeating ourselves; we do tricky things with
1117
        # file kind...
1118
        base_pair = contents_pair(self.base_tree)
1119
        other_pair = contents_pair(self.other_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1120
        if self._lca_trees:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1121
            this_pair = contents_pair(self.this_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1122
            lca_pairs = [contents_pair(tree) for tree in self._lca_trees]
1123
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1124
                                         this_pair, allow_overriding_lca=False)
1125
        else:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1126
            if base_pair == other_pair:
1127
                winner = 'this'
1128
            else:
1129
                # We delayed evaluating this_pair as long as we can to avoid
1130
                # unnecessary sha1 calculation
1131
                this_pair = contents_pair(self.this_tree)
1132
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1133
        if winner == 'this':
1134
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1135
            return "unmodified"
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1136
        trans_id = self.tt.trans_id_file_id(file_id)
1137
        if winner == 'other':
1138
            # OTHER is a straight winner, so replace this contents with other
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1139
            file_in_this = file_id in self.this_tree
1140
            if file_in_this:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1141
                # Remove any existing contents
1142
                self.tt.delete_contents(trans_id)
1143
            if file_id in self.other_tree:
1144
                # OTHER changed the file
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1145
                wt = self.this_tree
1146
                if wt.supports_content_filtering():
4634.102.3 by Ian Clatworthy
Use the working tree for path lookups as Robert suggested. We still need to fall back to the other tree though in the case of files being added.
1147
                    # We get the path from the working tree if it exists.
1148
                    # That fails though when OTHER is adding a file, so
1149
                    # we fall back to the other tree to find the path if
1150
                    # it doesn't exist locally.
1151
                    try:
1152
                        filter_tree_path = wt.id2path(file_id)
1153
                    except errors.NoSuchId:
1154
                        filter_tree_path = self.other_tree.id2path(file_id)
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1155
                else:
1156
                    # Skip the id2path lookup for older formats
1157
                    filter_tree_path = None
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1158
                transform.create_from_tree(self.tt, trans_id,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1159
                                 self.other_tree, file_id,
1160
                                 filter_tree_path=filter_tree_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1161
                if not file_in_this:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1162
                    self.tt.version_file(file_id, trans_id)
1163
                return "modified"
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1164
            elif file_in_this:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1165
                # OTHER deleted the file
1166
                self.tt.unversion_file(trans_id)
1167
                return "deleted"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1168
        else:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1169
            # We have a hypothetical conflict, but if we have files, then we
1170
            # can try to merge the content
1171
            if this_pair[0] == 'file' and other_pair[0] == 'file':
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1172
                # THIS and OTHER are both files, so text merge.  Either
1173
                # BASE is a file, or both converted to files, so at least we
1174
                # have agreement that output should be a file.
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1175
                try:
1176
                    self.text_merge(file_id, trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1177
                except errors.BinaryFile:
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1178
                    return contents_conflict()
3363.17.8 by Aaron Bentley
Get merge into a preview tree working
1179
                if file_id not in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1180
                    self.tt.version_file(file_id, trans_id)
1534.7.152 by Aaron Bentley
Fixed overwrites
1181
                try:
1182
                    self.tt.tree_kind(trans_id)
1183
                    self.tt.delete_contents(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1184
                except errors.NoSuchFile:
1534.7.152 by Aaron Bentley
Fixed overwrites
1185
                    pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1186
                return "modified"
1187
            else:
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1188
                return contents_conflict()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1189
1190
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1191
        """Return the lines in a file, or an empty list."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1192
        if file_id in tree:
1193
            return tree.get_file(file_id).readlines()
1194
        else:
1195
            return []
1196
1197
    def text_merge(self, file_id, trans_id):
1198
        """Perform a three-way text merge on a file_id"""
1199
        # it's possible that we got here with base as a different type.
1200
        # if so, we just want two-way text conflicts.
1201
        if file_id in self.base_tree and \
1202
            self.base_tree.kind(file_id) == "file":
1203
            base_lines = self.get_lines(self.base_tree, file_id)
1204
        else:
1205
            base_lines = []
1206
        other_lines = self.get_lines(self.other_tree, file_id)
1207
        this_lines = self.get_lines(self.this_tree, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1208
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1209
                           is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1210
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1211
        if self.show_base is True:
1212
            base_marker = '|' * 7
1213
        else:
1214
            base_marker = None
1215
1216
        def iter_merge3(retval):
1217
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1218
            for line in m3.merge_lines(name_a = "TREE",
1219
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1220
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1221
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1222
                                       base_marker=base_marker,
1223
                                       reprocess=self.reprocess):
1224
                if line.startswith(start_marker):
1225
                    retval["text_conflicts"] = True
1226
                    yield line.replace(start_marker, '<' * 7)
1227
                else:
1228
                    yield line
1229
        retval = {}
1230
        merge3_iterator = iter_merge3(retval)
1231
        self.tt.create_file(merge3_iterator, trans_id)
1232
        if retval["text_conflicts"] is True:
1233
            self._raw_conflicts.append(('text conflict', trans_id))
1234
            name = self.tt.final_name(trans_id)
1235
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1236
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1237
                                              this_lines, base_lines,
1238
                                              other_lines)
1239
            file_group.append(trans_id)
1240
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1241
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1242
                        base_lines=None, other_lines=None, set_version=False,
1243
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1244
        """Emit conflict files.
1245
        If this_lines, base_lines, or other_lines are omitted, they will be
1246
        determined automatically.  If set_version is true, the .OTHER, .THIS
1247
        or .BASE (in that order) will be created as versioned files.
1248
        """
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1249
        data = [('OTHER', self.other_tree, other_lines),
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1250
                ('THIS', self.this_tree, this_lines)]
1251
        if not no_base:
1252
            data.append(('BASE', self.base_tree, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1253
1254
        # We need to use the actual path in the working tree of the file here,
1255
        # ignoring the conflict suffixes
1256
        wt = self.this_tree
1257
        if wt.supports_content_filtering():
1258
            try:
1259
                filter_tree_path = wt.id2path(file_id)
1260
            except errors.NoSuchId:
1261
                # file has been deleted
1262
                filter_tree_path = None
1263
        else:
1264
            # Skip the id2path lookup for older formats
1265
            filter_tree_path = None
1266
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1267
        versioned = False
1268
        file_group = []
1269
        for suffix, tree, lines in data:
1270
            if file_id in tree:
1271
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1272
                                               suffix, lines, filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1273
                file_group.append(trans_id)
1274
                if set_version and not versioned:
1275
                    self.tt.version_file(file_id, trans_id)
1276
                    versioned = True
1277
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1278
3363.17.21 by Aaron Bentley
Conflicts are handled when merging from preview trees
1279
    def _conflict_file(self, name, parent_id, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1280
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1281
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1282
        name = name + '.' + suffix
1283
        trans_id = self.tt.create_path(name, parent_id)
4854.1.1 by Andrew Bennetts
Merge lp:bzr/2.0 into lp:bzr.
1284
        transform.create_from_tree(self.tt, trans_id, tree, file_id, lines,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1285
            filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1286
        return trans_id
1287
1288
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1289
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1290
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1291
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1292
        self._merge_executable(file_id, executable, file_status,
1293
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1294
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1295
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1296
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1297
        """Perform a merge on the execute bit."""
1298
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1299
        if file_status == "deleted":
1300
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1301
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1302
        if winner == "conflict":
1303
        # There must be a None in here, if we have a conflict, but we
1304
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1305
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1306
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1307
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1308
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1309
        if winner == 'this' and file_status != "modified":
1310
            return
1311
        trans_id = self.tt.trans_id_file_id(file_id)
1312
        try:
1313
            if self.tt.final_kind(trans_id) != "file":
1314
                return
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1315
        except errors.NoSuchFile:
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1316
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1317
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1318
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1319
        else:
1320
            if file_id in self.other_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1321
                executability = other_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1322
            elif file_id in self.this_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1323
                executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1324
            elif file_id in self.base_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1325
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1326
        if executability is not None:
1327
            trans_id = self.tt.trans_id_file_id(file_id)
1328
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1329
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1330
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1331
        """Convert all conflicts into a form that doesn't depend on trans_id"""
1332
        name_conflicts = {}
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1333
        self.cooked_conflicts.extend(transform.cook_conflicts(
1334
                fs_conflicts, self.tt))
1335
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1336
        for conflict in self._raw_conflicts:
1337
            conflict_type = conflict[0]
1338
            if conflict_type in ('name conflict', 'parent conflict'):
1339
                trans_id = conflict[1]
1340
                conflict_args = conflict[2:]
1341
                if trans_id not in name_conflicts:
1342
                    name_conflicts[trans_id] = {}
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1343
                transform.unique_add(name_conflicts[trans_id], conflict_type,
1344
                                     conflict_args)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1345
            if conflict_type == 'contents conflict':
1346
                for trans_id in conflict[1]:
1347
                    file_id = self.tt.final_file_id(trans_id)
1348
                    if file_id is not None:
1349
                        break
1350
                path = fp.get_path(trans_id)
1351
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1352
                    if path.endswith(suffix):
1353
                        path = path[:-len(suffix)]
1354
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1355
                c = _mod_conflicts.Conflict.factory(conflict_type,
1356
                                                    path=path, file_id=file_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1357
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1358
            if conflict_type == 'text conflict':
1359
                trans_id = conflict[1]
1360
                path = fp.get_path(trans_id)
1361
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1362
                c = _mod_conflicts.Conflict.factory(conflict_type,
1363
                                                    path=path, file_id=file_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1364
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1365
1366
        for trans_id, conflicts in name_conflicts.iteritems():
1367
            try:
1368
                this_parent, other_parent = conflicts['parent conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1369
                if this_parent == other_parent:
1370
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1371
            except KeyError:
1372
                this_parent = other_parent = \
1373
                    self.tt.final_file_id(self.tt.final_parent(trans_id))
1374
            try:
1375
                this_name, other_name = conflicts['name conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1376
                if this_name == other_name:
1377
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1378
            except KeyError:
1379
                this_name = other_name = self.tt.final_name(trans_id)
1380
            other_path = fp.get_path(trans_id)
1551.16.2 by Aaron Bentley
Don't crash on merging renamed deleted files (#110279)
1381
            if this_parent is not None and this_name is not None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1382
                this_parent_path = \
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1383
                    fp.get_path(self.tt.trans_id_file_id(this_parent))
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1384
                this_path = osutils.pathjoin(this_parent_path, this_name)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1385
            else:
1386
                this_path = "<deleted>"
1387
            file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1388
            c = _mod_conflicts.Conflict.factory('path conflict', path=this_path,
1389
                                                conflict_path=other_path,
1390
                                                file_id=file_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1391
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1392
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1393
1394
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1395
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1396
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1397
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1398
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1399
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1400
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1401
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1402
    def _generate_merge_plan(self, file_id, base):
1403
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1404
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1405
1406
    def _merged_lines(self, file_id):
1407
        """Generate the merged lines.
1408
        There is no distinction between lines that are meant to contain <<<<<<<
1409
        and conflicts.
1410
        """
1411
        if self.cherrypick:
1412
            base = self.base_tree
1413
        else:
1414
            base = None
1415
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1416
        if 'merge' in debug.debug_flags:
1417
            plan = list(plan)
1418
            trans_id = self.tt.trans_id_file_id(file_id)
1419
            name = self.tt.final_name(trans_id) + '.plan'
4634.101.6 by John Arbash Meinel
killed-both and killed-base is 11 chars long.
1420
            contents = ('%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1421
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1422
        textmerge = versionedfile.PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1423
                                                 '>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1424
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1425
        if conflicts:
1426
            base_lines = textmerge.base_from_plan()
1427
        else:
1428
            base_lines = None
1429
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1430
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1431
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1432
        """Perform a (weave) text merge for a given file and file-id.
1433
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1434
        and a conflict will be noted.
1435
        """
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1436
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1437
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1438
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1439
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1440
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1441
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1442
        if base_lines is not None:
1443
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1444
            self._raw_conflicts.append(('text conflict', trans_id))
1445
            name = self.tt.final_name(trans_id)
1446
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1447
            file_group = self._dump_conflicts(name, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1448
                                              no_base=False,
1449
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1450
            file_group.append(trans_id)
1451
1452
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1453
class LCAMerger(WeaveMerger):
1454
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1455
    def _generate_merge_plan(self, file_id, base):
1456
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1457
                                                  base=base)
1458
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1459
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1460
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1461
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1462
    def dump_file(self, temp_dir, name, tree, file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1463
        out_path = osutils.pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1464
        out_file = open(out_path, "wb")
1465
        try:
1466
            in_file = tree.get_file(file_id)
1467
            for line in in_file:
1468
                out_file.write(line)
1469
        finally:
1470
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1471
        return out_path
1472
1473
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1474
        """Perform a diff3 merge using a specified file-id and trans-id.
1475
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1476
        will be dumped, and a will be conflict noted.
1477
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1478
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1479
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1480
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1481
            new_file = osutils.pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1482
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1483
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1484
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1485
            status = bzrlib.patch.diff3(new_file, this, base, other)
1486
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1487
                raise errors.BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1488
            f = open(new_file, 'rb')
1489
            try:
1490
                self.tt.create_file(f, trans_id)
1491
            finally:
1492
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1493
            if status == 1:
1494
                name = self.tt.final_name(trans_id)
1495
                parent_id = self.tt.final_parent(trans_id)
1496
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1497
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1498
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1499
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1500
1501
1502
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1503
                backup_files=False,
1504
                merge_type=Merge3Merger,
1505
                interesting_ids=None,
1506
                show_base=False,
1507
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1508
                other_rev_id=None,
1509
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1510
                this_tree=None,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
1511
                pb=None,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1512
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1513
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1514
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1515
        typical use is probably
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1516
        'merge_inner(branch, branch.get_revision_tree(other_revision),
1517
                     branch.get_revision_tree(base_revision))'
1518
        """
1519
    if this_tree is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1520
        raise errors.BzrError("bzrlib.merge.merge_inner requires a this_tree "
1521
                              "parameter as of bzrlib version 0.8.")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1522
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1523
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1524
    merger.backup_files = backup_files
1525
    merger.merge_type = merge_type
1526
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1527
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1528
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1529
        if interesting_ids:
1530
            raise ValueError('Only supply interesting_ids'
1531
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1532
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1533
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1534
    merger.reprocess = reprocess
1535
    merger.other_rev_id = other_rev_id
1536
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1537
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1538
    if get_revision_id is None:
1539
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1540
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1541
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1542
    return merger.do_merge()
1543
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1544
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1545
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1546
1547
    This method provides a sanctioned way to retrieve it.
1548
    """
1549
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1550
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1551
1552
1553
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1554
    def status_a(revision, text):
1555
        if revision in ancestors_b:
1556
            return 'killed-b', text
1557
        else:
1558
            return 'new-a', text
1559
1560
    def status_b(revision, text):
1561
        if revision in ancestors_a:
1562
            return 'killed-a', text
1563
        else:
1564
            return 'new-b', text
1565
1566
    plain_a = [t for (a, t) in annotated_a]
1567
    plain_b = [t for (a, t) in annotated_b]
1568
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1569
    blocks = matcher.get_matching_blocks()
1570
    a_cur = 0
1571
    b_cur = 0
1572
    for ai, bi, l in blocks:
1573
        # process all mismatched sections
1574
        # (last mismatched section is handled because blocks always
1575
        # includes a 0-length last block)
1576
        for revision, text in annotated_a[a_cur:ai]:
1577
            yield status_a(revision, text)
1578
        for revision, text in annotated_b[b_cur:bi]:
1579
            yield status_b(revision, text)
1580
        # and now the matched section
1581
        a_cur = ai + l
1582
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
1583
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
1584
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1585
1586
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1587
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1588
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1589
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1590
        """Contructor.
1591
1592
        :param a_rev: Revision-id of one revision to merge
1593
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1594
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1595
        :param key_prefix: A prefix for accessing keys in vf, typically
1596
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1597
        """
1598
        self.a_rev = a_rev
1599
        self.b_rev = b_rev
1600
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
1601
        self._last_lines = None
1602
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
1603
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1604
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1605
        self._precache_tip_lines()
1606
1607
    def _precache_tip_lines(self):
1608
        lines = self.get_lines([self.a_rev, self.b_rev])
1609
        self.lines_a = lines[self.a_rev]
1610
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1611
1612
    def get_lines(self, revisions):
1613
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
1614
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1615
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1616
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1617
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1618
        result = {}
1619
        for record in self.vf.get_record_stream(keys, 'unordered', True):
1620
            if record.storage_kind == 'absent':
1621
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
1622
            result[record.key[-1]] = osutils.chunks_to_lines(
1623
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1624
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1625
1626
    def plan_merge(self):
1627
        """Generate a 'plan' for merging the two revisions.
1628
1629
        This involves comparing their texts and determining the cause of
1630
        differences.  If text A has a line and text B does not, then either the
1631
        line was added to text A, or it was deleted from B.  Once the causes
1632
        are combined, they are written out in the format described in
1633
        VersionedFile.plan_merge
1634
        """
1635
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1636
        unique_a, unique_b = self._unique_lines(blocks)
1637
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
1638
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
1639
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
1640
1641
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1642
        last_i = 0
1643
        last_j = 0
1644
        for i, j, n in blocks:
1645
            for a_index in range(last_i, i):
1646
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
1647
                    if a_index in killed_b:
1648
                        yield 'conflicted-a', self.lines_a[a_index]
1649
                    else:
1650
                        yield 'new-a', self.lines_a[a_index]
1651
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1652
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1653
            for b_index in range(last_j, j):
1654
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
1655
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
1656
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
1657
                    else:
1658
                        yield 'new-b', self.lines_b[b_index]
1659
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1660
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1661
            # handle common lines
1662
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1663
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1664
            last_i = i+n
1665
            last_j = j+n
1666
1667
    def _get_matching_blocks(self, left_revision, right_revision):
1668
        """Return a description of which sections of two revisions match.
1669
1670
        See SequenceMatcher.get_matching_blocks
1671
        """
3144.3.7 by Aaron Bentley
Update from review
1672
        cached = self._cached_matching_blocks.get((left_revision,
1673
                                                   right_revision))
1674
        if cached is not None:
1675
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
1676
        if self._last_lines_revision_id == left_revision:
1677
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1678
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1679
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1680
            lines = self.get_lines([left_revision, right_revision])
1681
            left_lines = lines[left_revision]
1682
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1683
        self._last_lines = right_lines
1684
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1685
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
1686
                                                       right_lines)
1687
        return matcher.get_matching_blocks()
1688
1689
    def _unique_lines(self, matching_blocks):
1690
        """Analyse matching_blocks to determine which lines are unique
1691
1692
        :return: a tuple of (unique_left, unique_right), where the values are
1693
            sets of line numbers of unique lines.
1694
        """
1695
        last_i = 0
1696
        last_j = 0
1697
        unique_left = []
1698
        unique_right = []
1699
        for i, j, n in matching_blocks:
1700
            unique_left.extend(range(last_i, i))
1701
            unique_right.extend(range(last_j, j))
1702
            last_i = i + n
1703
            last_j = j + n
1704
        return unique_left, unique_right
1705
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1706
    @staticmethod
1707
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
1708
        """Remove changes from new_plan that came from old_plan.
1709
1710
        It is assumed that the difference between the old_plan and new_plan
1711
        is their choice of 'b' text.
1712
1713
        All lines from new_plan that differ from old_plan are emitted
1714
        verbatim.  All lines from new_plan that match old_plan but are
1715
        not about the 'b' revision are emitted verbatim.
1716
1717
        Lines that match and are about the 'b' revision are the lines we
1718
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
1719
        is skipped entirely.
1720
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1721
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
1722
                                                       new_plan)
1723
        last_j = 0
1724
        for i, j, n in matcher.get_matching_blocks():
1725
            for jj in range(last_j, j):
1726
                yield new_plan[jj]
1727
            for jj in range(j, j+n):
1728
                plan_line = new_plan[jj]
1729
                if plan_line[0] == 'new-b':
1730
                    pass
1731
                elif plan_line[0] == 'killed-b':
1732
                    yield 'unchanged', plan_line[1]
1733
                else:
1734
                    yield plan_line
1735
            last_j = j + n
1736
1737
1738
class _PlanMerge(_PlanMergeBase):
1739
    """Plan an annotate merge using on-the-fly annotation"""
1740
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1741
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1742
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
1743
        self.a_key = self._key_prefix + (self.a_rev,)
1744
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1745
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
1746
        heads = self.graph.heads((self.a_key, self.b_key))
1747
        if len(heads) == 1:
1748
            # one side dominates, so we can just return its values, yay for
1749
            # per-file graphs
1750
            # Ideally we would know that before we get this far
1751
            self._head_key = heads.pop()
1752
            if self._head_key == self.a_key:
1753
                other = b_rev
1754
            else:
1755
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1756
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
1757
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
1758
            self._weave = None
1759
        else:
1760
            self._head_key = None
1761
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1762
1763
    def _precache_tip_lines(self):
1764
        # Turn this into a no-op, because we will do this later
1765
        pass
1766
1767
    def _find_recursive_lcas(self):
1768
        """Find all the ancestors back to a unique lca"""
1769
        cur_ancestors = (self.a_key, self.b_key)
1770
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1771
        # rather than a key tuple. We will just map that directly to no common
1772
        # ancestors.
1773
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1774
        while True:
1775
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1776
            # Map a plain NULL_REVISION to a simple no-ancestors
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1777
            if next_lcas == set([_mod_revision.NULL_REVISION]):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1778
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1779
            # Order the lca's based on when they were merged into the tip
1780
            # While the actual merge portion of weave merge uses a set() of
1781
            # active revisions, the order of insertion *does* effect the
1782
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1783
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1784
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
1785
                                                                    next_lcas))
1786
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1787
            if len(next_lcas) == 0:
1788
                break
1789
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1790
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1791
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
1792
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1793
                # More than 2 lca's, fall back to grabbing all nodes between
1794
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1795
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
1796
                             ' %s, %s\n=> %s',
1797
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1798
                cur_lcas = next_lcas
1799
                while len(cur_lcas) > 1:
1800
                    cur_lcas = self.graph.find_lca(*cur_lcas)
1801
                if len(cur_lcas) == 0:
1802
                    # No common base to find, use the full ancestry
1803
                    unique_lca = None
1804
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1805
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1806
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1807
                        # find_lca will return a plain 'NULL_REVISION' rather
1808
                        # than a key tuple when there is no common ancestor, we
1809
                        # prefer to just use None, because it doesn't confuse
1810
                        # _get_interesting_texts()
1811
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1812
                parent_map.update(self._find_unique_parents(next_lcas,
1813
                                                            unique_lca))
1814
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1815
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1816
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1817
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1818
    def _find_unique_parents(self, tip_keys, base_key):
1819
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1820
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1821
        :param tip_keys: Nodes that are interesting
1822
        :param base_key: Cull all ancestors of this node
1823
        :return: The parent map for all revisions between tip_keys and
1824
            base_key. base_key will be included. References to nodes outside of
1825
            the ancestor set will also be removed.
1826
        """
1827
        # TODO: this would be simpler if find_unique_ancestors took a list
1828
        #       instead of a single tip, internally it supports it, but it
1829
        #       isn't a "backwards compatible" api change.
1830
        if base_key is None:
1831
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1832
            # We remove NULL_REVISION because it isn't a proper tuple key, and
1833
            # thus confuses things like _get_interesting_texts, and our logic
1834
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1835
            if _mod_revision.NULL_REVISION in parent_map:
1836
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1837
        else:
1838
            interesting = set()
1839
            for tip in tip_keys:
1840
                interesting.update(
1841
                    self.graph.find_unique_ancestors(tip, [base_key]))
1842
            parent_map = self.graph.get_parent_map(interesting)
1843
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1844
        culled_parent_map, child_map, tails = self._remove_external_references(
1845
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1846
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1847
        if base_key is not None:
1848
            tails.remove(base_key)
1849
            self._prune_tails(culled_parent_map, child_map, tails)
1850
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
1851
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
1852
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1853
1854
    @staticmethod
1855
    def _remove_external_references(parent_map):
1856
        """Remove references that go outside of the parent map.
1857
1858
        :param parent_map: Something returned from Graph.get_parent_map(keys)
1859
        :return: (filtered_parent_map, child_map, tails)
1860
            filtered_parent_map is parent_map without external references
1861
            child_map is the {parent_key: [child_keys]} mapping
1862
            tails is a list of nodes that do not have any parents in the map
1863
        """
1864
        # TODO: The basic effect of this function seems more generic than
1865
        #       _PlanMerge. But the specific details of building a child_map,
1866
        #       and computing tails seems very specific to _PlanMerge.
1867
        #       Still, should this be in Graph land?
1868
        filtered_parent_map = {}
1869
        child_map = {}
1870
        tails = []
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1871
        for key, parent_keys in parent_map.iteritems():
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1872
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
1873
            if not culled_parent_keys:
1874
                tails.append(key)
1875
            for parent_key in culled_parent_keys:
1876
                child_map.setdefault(parent_key, []).append(key)
1877
            # TODO: Do we want to do this, it adds overhead for every node,
1878
            #       just to say that the node has no children
1879
            child_map.setdefault(key, [])
1880
            filtered_parent_map[key] = culled_parent_keys
1881
        return filtered_parent_map, child_map, tails
1882
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1883
    @staticmethod
1884
    def _prune_tails(parent_map, child_map, tails_to_remove):
1885
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1886
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1887
        This will remove the supplied revisions until no more children have 0
1888
        parents.
1889
1890
        :param parent_map: A dict of {child: [parents]}, this dictionary will
1891
            be modified in place.
1892
        :param tails_to_remove: A list of tips that should be removed,
1893
            this list will be consumed
1894
        :param child_map: The reverse dict of parent_map ({parent: [children]})
1895
            this dict will be modified
1896
        :return: None, parent_map will be modified in place.
1897
        """
1898
        while tails_to_remove:
1899
            next = tails_to_remove.pop()
1900
            parent_map.pop(next)
1901
            children = child_map.pop(next)
1902
            for child in children:
1903
                child_parents = parent_map[child]
1904
                child_parents.remove(next)
1905
                if len(child_parents) == 0:
1906
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1907
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1908
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1909
        """Return a dict of texts we are interested in.
1910
1911
        Note that the input is in key tuples, but the output is in plain
1912
        revision ids.
1913
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1914
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1915
        :return: A dict of {'revision_id':lines} as returned by
1916
            _PlanMergeBase.get_lines()
1917
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1918
        all_revision_keys = set(parent_map)
1919
        all_revision_keys.add(self.a_key)
1920
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1921
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1922
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
1923
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1924
        return all_texts
1925
1926
    def _build_weave(self):
1927
        from bzrlib import weave
1928
        self._weave = weave.Weave(weave_name='in_memory_weave',
1929
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1930
        parent_map = self._find_recursive_lcas()
1931
1932
        all_texts = self._get_interesting_texts(parent_map)
1933
1934
        # Note: Unfortunately, the order given by topo_sort will effect the
1935
        # ordering resolution in the output. Specifically, if you add A then B,
1936
        # then in the output text A lines will show up before B lines. And, of
1937
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1938
        # So we use merge_sort, and add a fake node on the tip.
1939
        # This ensures that left-hand parents will always be inserted into the
1940
        # weave before right-hand parents.
1941
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
1942
        parent_map[tip_key] = (self.a_key, self.b_key)
1943
1944
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
1945
                                                                  tip_key)):
1946
            if key == tip_key:
1947
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1948
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1949
            parent_keys = parent_map[key]
1950
            revision_id = key[-1]
1951
            parent_ids = [k[-1] for k in parent_keys]
1952
            self._weave.add_lines(revision_id, parent_ids,
1953
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1954
1955
    def plan_merge(self):
1956
        """Generate a 'plan' for merging the two revisions.
1957
1958
        This involves comparing their texts and determining the cause of
1959
        differences.  If text A has a line and text B does not, then either the
1960
        line was added to text A, or it was deleted from B.  Once the causes
1961
        are combined, they are written out in the format described in
1962
        VersionedFile.plan_merge
1963
        """
1964
        if self._head_key is not None: # There was a single head
1965
            if self._head_key == self.a_key:
1966
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1967
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1968
                if self._head_key != self.b_key:
1969
                    raise AssertionError('There was an invalid head: %s != %s'
1970
                                         % (self.b_key, self._head_key))
1971
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
1972
            head_rev = self._head_key[-1]
1973
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1974
            return ((plan, line) for line in lines)
1975
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
1976
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1977
1978
class _PlanLCAMerge(_PlanMergeBase):
1979
    """
3144.3.7 by Aaron Bentley
Update from review
1980
    This merge algorithm differs from _PlanMerge in that:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1981
    1. comparisons are done against LCAs only
1982
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
1983
       another are marked as conflicts, by emitting the line as conflicted-a
1984
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1985
1986
    This is faster, and hopefully produces more useful output.
1987
    """
1988
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1989
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
1990
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
1991
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
1992
        self.lcas = set()
1993
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1994
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
1995
                self.lcas.add(lca)
1996
            else:
1997
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
1998
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
1999
            if _mod_revision.is_null(lca):
2000
                lca_lines = []
2001
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2002
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2003
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2004
                                                           lca_lines)
2005
            blocks = list(matcher.get_matching_blocks())
2006
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2007
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2008
                                                           lca_lines)
2009
            blocks = list(matcher.get_matching_blocks())
2010
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2011
3144.3.7 by Aaron Bentley
Update from review
2012
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2013
        """Determines the status unique lines versus all lcas.
2014
2015
        Basically, determines why the line is unique to this revision.
2016
2017
        A line may be determined new, killed, or both.
2018
3144.3.7 by Aaron Bentley
Update from review
2019
        If a line is determined new, that means it was not present in at least
2020
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2021
2022
        If a line is determined killed, that means the line was present in
2023
        at least one LCA.
2024
2025
        If a line is killed and new, this indicates that the two merge
2026
        revisions contain differing conflict resolutions.
3144.3.7 by Aaron Bentley
Update from review
2027
        :param revision_id: The id of the revision in which the lines are
2028
            unique
2029
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2030
        :return a tuple of (new_this, killed_other):
2031
        """
2032
        new = set()
2033
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2034
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2035
        for lca in self.lcas:
2036
            blocks = self._get_matching_blocks(revision_id, lca)
2037
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2038
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2039
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2040
        return new, killed