/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1
# Copyright (C) 2005, 2006, 2008 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
17
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
18
import errno
19
from itertools import chain
1185.1.2 by Martin Pool
- merge various windows and other fixes from Ollie Rutherfurd
20
import os
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
21
import warnings
1113 by Martin Pool
- fix is_ancestor import problem in merge
22
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
23
from bzrlib import (
1551.19.17 by Aaron Bentley
Add debugging flag for merges
24
    debug,
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
25
    errors,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
26
    graph as _mod_graph,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
27
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
28
    patiencediff,
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
29
    registry,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
30
    revision as _mod_revision,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
31
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
32
    tsort,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
33
    )
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
34
from bzrlib.branch import Branch
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
35
from bzrlib.conflicts import ConflictList, Conflict
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
36
from bzrlib.errors import (BzrCommandError,
1534.4.28 by Robert Collins
first cut at merge from integration.
37
                           BzrError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
38
                           NoCommonAncestor,
39
                           NoCommits,
1534.4.28 by Robert Collins
first cut at merge from integration.
40
                           NoSuchRevision,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
41
                           NoSuchFile,
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
42
                           NotBranchError,
1185.33.27 by Martin Pool
[merge] much integrated work from robert and john
43
                           NotVersionedError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
44
                           UnrelatedBranches,
1534.10.12 by Aaron Bentley
Merge produces new conflicts
45
                           UnsupportedOperation,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
46
                           WorkingTreeNotRevision,
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
47
                           BinaryFile,
1534.4.28 by Robert Collins
first cut at merge from integration.
48
                           )
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
49
from bzrlib.graph import Graph
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
50
from bzrlib.merge3 import Merge3
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
51
from bzrlib.osutils import rename, pathjoin
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
52
from progress import DummyProgress, ProgressPhase
3052.1.3 by John Arbash Meinel
deprecate revision.is_ancestor, update the callers and the tests.
53
from bzrlib.revision import (NULL_REVISION, ensure_null)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
54
from bzrlib.textfile import check_text_lines
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
55
from bzrlib.trace import mutter, warning, note, is_quiet
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
56
from bzrlib.transform import (TransformPreview, TreeTransform,
57
                              resolve_conflicts, cook_conflicts,
3363.17.25 by Aaron Bentley
remove get_inventory_entry, replace with create_from_tree
58
                              conflict_pass, FinalPaths, create_from_tree,
2590.2.8 by Aaron Bentley
Restore conflict handling changes
59
                              unique_add, ROOT_PARENT)
1551.15.46 by Aaron Bentley
Move plan merge to tree
60
from bzrlib.versionedfile import PlanWeaveMerge
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
61
from bzrlib import ui
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
62
63
# TODO: Report back as changes are merged in
64
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
65
1185.35.4 by Aaron Bentley
Implemented remerge
66
def transform_tree(from_tree, to_tree, interesting_ids=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
67
    from_tree.lock_tree_write()
68
    try:
69
        merge_inner(from_tree.branch, to_tree, from_tree, ignore_zero=True,
70
                    interesting_ids=interesting_ids, this_tree=from_tree)
71
    finally:
72
        from_tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
73
1457.1.12 by Robert Collins
Update comment to reflect author.
74
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
75
class Merger(object):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
76
    def __init__(self, this_branch, other_tree=None, base_tree=None,
1551.21.8 by Aaron Bentley
Remove now-redundant DummyProgress from Merger.__init__
77
                 this_tree=None, pb=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
78
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
79
        object.__init__(self)
80
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
81
        self.this_basis = _mod_revision.ensure_null(
82
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
83
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
84
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
85
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
86
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
87
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
88
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
89
        self.base_tree = base_tree
90
        self.ignore_zero = False
91
        self.backup_files = False
92
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
93
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
94
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
95
        self.reprocess = False
1551.21.7 by Aaron Bentley
Fix progress warning
96
        if pb is None:
97
            pb = DummyProgress()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
98
        self._pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
99
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
100
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
101
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
102
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
103
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
104
        self._base_is_ancestor = None
105
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
106
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
107
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
108
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
109
    def cache_trees_with_revision_ids(self, trees):
110
        """Cache any tree in trees if it has a revision_id."""
111
        for maybe_tree in trees:
112
            if maybe_tree is None:
113
                continue
114
            try:
115
                rev_id = maybe_tree.get_revision_id()
116
            except AttributeError:
117
                continue
118
            self._cached_trees[rev_id] = maybe_tree
119
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
120
    @property
121
    def revision_graph(self):
122
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
123
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
124
        return self._revision_graph
125
126
    def _set_base_is_ancestor(self, value):
127
        self._base_is_ancestor = value
128
129
    def _get_base_is_ancestor(self):
130
        if self._base_is_ancestor is None:
131
            self._base_is_ancestor = self.revision_graph.is_ancestor(
132
                self.base_rev_id, self.this_basis)
133
        return self._base_is_ancestor
134
135
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
136
137
    def _set_base_is_other_ancestor(self, value):
138
        self._base_is_other_ancestor = value
139
140
    def _get_base_is_other_ancestor(self):
141
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
142
            if self.other_basis is None:
143
                return True
144
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
145
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
146
        return self._base_is_other_ancestor
147
148
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
149
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
150
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
151
    @staticmethod
1551.21.7 by Aaron Bentley
Fix progress warning
152
    def from_uncommitted(tree, other_tree, pb=None, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
153
        """Return a Merger for uncommitted changes in other_tree.
154
155
        :param tree: The tree to merge into
156
        :param other_tree: The tree to get uncommitted changes from
157
        :param pb: A progress indicator
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
158
        :param base_tree: The basis to use for the merge.  If unspecified,
159
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
160
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
161
        if base_tree is None:
162
            base_tree = other_tree.basis_tree()
163
        merger = Merger(tree.branch, other_tree, base_tree, tree, pb)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
164
        merger.base_rev_id = merger.base_tree.get_revision_id()
165
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
166
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
167
        return merger
168
169
    @classmethod
170
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
171
        """Return a Merger for a bundle or merge directive.
172
173
        :param tree: The tree to merge changes into
174
        :param mergeable: A merge directive or bundle
175
        :param pb: A progress indicator
176
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
177
        mergeable.install_revisions(tree.branch.repository)
178
        base_revision_id, other_revision_id, verified =\
179
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
180
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
181
        if base_revision_id is not None:
182
            if (base_revision_id != _mod_revision.NULL_REVISION and
183
                revision_graph.is_ancestor(
184
                base_revision_id, tree.branch.last_revision())):
185
                base_revision_id = None
186
            else:
187
                warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
188
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
189
                                         base_revision_id, revision_graph=
190
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
191
        return merger, verified
192
193
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
194
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
195
                          base_branch=None, revision_graph=None,
196
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
197
        """Return a Merger for revision-ids.
198
3363.17.15 by Aaron Bentley
Update docs
199
        :param pb: A progress indicator
1551.15.74 by Aaron Bentley
Textual updates from review
200
        :param tree: The tree to merge changes into
201
        :param other: The revision-id to use as OTHER
202
        :param base: The revision-id to use as BASE.  If not specified, will
203
            be auto-selected.
204
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
205
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
206
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
207
            not supplied, other_branch or tree.branch will be used.
208
        :param revision_graph: If you have a revision_graph precomputed, pass
209
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
210
        :param tree_branch: The branch associated with tree.  If not supplied,
211
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
212
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
213
        if tree_branch is None:
214
            tree_branch = tree.branch
215
        merger = Merger(tree_branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
216
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
217
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
218
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
219
        merger.set_other_revision(other, other_branch)
220
        if base is None:
221
            merger.find_base()
222
        else:
223
            if base_branch is None:
224
                base_branch = other_branch
225
            merger.set_base_revision(base, base_branch)
226
        return merger
227
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
228
    def revision_tree(self, revision_id, branch=None):
229
        if revision_id not in self._cached_trees:
230
            if branch is None:
231
                branch = self.this_branch
232
            try:
233
                tree = self.this_tree.revision_tree(revision_id)
234
            except errors.NoSuchRevisionInTree:
235
                tree = branch.repository.revision_tree(revision_id)
236
            self._cached_trees[revision_id] = tree
237
        return self._cached_trees[revision_id]
238
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
239
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
240
        from bzrlib import workingtree
241
        location, revno = treespec
242
        if revno is None:
243
            tree = workingtree.WorkingTree.open_containing(location)[0]
244
            return tree.branch, tree
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
245
        branch = Branch.open_containing(location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
246
        if revno == -1:
247
            revision_id = branch.last_revision()
248
        else:
249
            revision_id = branch.get_rev_id(revno)
250
        revision_id = ensure_null(revision_id)
251
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
252
253
    def ensure_revision_trees(self):
254
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
255
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
256
            if self.this_basis == self.this_rev_id:
257
                self.this_revision_tree = self.this_basis_tree
258
1185.12.83 by Aaron Bentley
Preliminary weave merge support
259
        if self.other_rev_id is None:
260
            other_basis_tree = self.revision_tree(self.other_basis)
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
261
            if other_basis_tree.has_changes(self.other_tree):
1185.12.83 by Aaron Bentley
Preliminary weave merge support
262
                raise WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
263
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
264
            self.other_tree = other_basis_tree
265
266
    def file_revisions(self, file_id):
267
        self.ensure_revision_trees()
268
        def get_id(tree, file_id):
269
            revision_id = tree.inventory[file_id].revision
270
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
271
        if self.this_rev_id is None:
272
            if self.this_basis_tree.get_file_sha1(file_id) != \
273
                self.this_tree.get_file_sha1(file_id):
274
                raise WorkingTreeNotRevision(self.this_tree)
275
276
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
277
        return [get_id(tree, file_id) for tree in trees]
278
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
279
    def check_basis(self, check_clean, require_commits=True):
280
        if self.this_basis is None and require_commits is True:
2249.3.1 by John Arbash Meinel
Mention using 'bzr pull' if there are no commits in current branch
281
            raise BzrCommandError("This branch has no commits."
282
                                  " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
283
        if check_clean:
284
            self.compare_basis()
285
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
286
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
287
288
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
289
        try:
290
            basis_tree = self.revision_tree(self.this_tree.last_revision())
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
291
        except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
292
            basis_tree = self.this_tree.basis_tree()
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
293
        if not self.this_tree.has_changes(basis_tree):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
294
            self.this_rev_id = self.this_basis
295
296
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
297
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
298
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
299
    def set_pending(self):
2644.1.1 by Wouter van Heyst
Fix bug #127115 by checking for self.other_rev_id being None in Merger.set_pending()
300
        if not self.base_is_ancestor or not self.base_is_other_ancestor or self.other_rev_id is None:
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
301
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
302
        self._add_parent()
303
304
    def _add_parent(self):
305
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
306
        new_parent_trees = []
307
        for revision_id in new_parents:
308
            try:
309
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
310
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
311
                tree = None
312
            else:
313
                tree.lock_read()
314
            new_parent_trees.append((revision_id, tree))
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
315
        try:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
316
            self.this_tree.set_parent_trees(new_parent_trees,
317
                                            allow_leftmost_as_ghost=True)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
318
        finally:
319
            for _revision_id, tree in new_parent_trees:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
320
                if tree is not None:
321
                    tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
322
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
323
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
324
        """Set the revision and tree to merge from.
325
326
        This sets the other_tree, other_rev_id, other_basis attributes.
327
328
        :param other_revision: The [path, revision] list to merge from.
329
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
330
        self.other_branch, self.other_tree = self._get_tree(other_revision,
331
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
332
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
333
            self.other_rev_id = _mod_revision.ensure_null(
334
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
335
            if _mod_revision.is_null(self.other_rev_id):
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
336
                raise NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
337
            self.other_basis = self.other_rev_id
338
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
339
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
340
            self.other_basis = self.other_rev_id
341
        else:
342
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
343
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
344
            if self.other_basis is None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
345
                raise NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
346
        if self.other_rev_id is not None:
347
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
348
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
349
2100.3.29 by Aaron Bentley
Get merge working initially
350
    def set_other_revision(self, revision_id, other_branch):
351
        """Set 'other' based on a branch and revision id
352
353
        :param revision_id: The revision to use for a tree
354
        :param other_branch: The branch containing this tree
355
        """
356
        self.other_rev_id = revision_id
357
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
358
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
359
        self.other_tree = self.revision_tree(revision_id)
360
        self.other_basis = revision_id
361
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
362
    def set_base_revision(self, revision_id, branch):
363
        """Set 'base' based on a branch and revision id
364
365
        :param revision_id: The revision to use for a tree
366
        :param branch: The branch containing this tree
367
        """
368
        self.base_rev_id = revision_id
369
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
370
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
371
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
372
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
373
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
374
        if not source.repository.has_same_location(target.repository):
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
375
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
376
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
377
    def find_base(self):
2590.2.22 by Aaron Bentley
Remove cruft
378
        revisions = [ensure_null(self.this_basis),
379
                     ensure_null(self.other_basis)]
380
        if NULL_REVISION in revisions:
381
            self.base_rev_id = NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
382
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
383
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
384
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
385
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
386
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
387
            if len(lcas) == 0:
388
                self.base_rev_id = NULL_REVISION
389
            elif len(lcas) == 1:
390
                self.base_rev_id = list(lcas)[0]
391
            else: # len(lcas) > 1
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
392
                if len(lcas) > 2:
393
                    # find_unique_lca can only handle 2 nodes, so we have to
394
                    # start back at the beginning. It is a shame to traverse
395
                    # the graph again, but better than re-implementing
396
                    # find_unique_lca.
397
                    self.base_rev_id = self.revision_graph.find_unique_lca(
398
                                            revisions[0], revisions[1])
399
                else:
400
                    self.base_rev_id = self.revision_graph.find_unique_lca(
401
                                            *lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
402
                self._is_criss_cross = True
2590.2.22 by Aaron Bentley
Remove cruft
403
            if self.base_rev_id == NULL_REVISION:
404
                raise UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
405
            if self._is_criss_cross:
1551.19.11 by Aaron Bentley
Add criss-cross help topic
406
                warning('Warning: criss-cross merge encountered.  See bzr'
407
                        ' help criss-cross.')
3948.1.2 by Vincent Ladeuil
* bzrlib/merge.py:
408
                mutter('Criss-cross lcas: %r' % lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
409
                interesting_revision_ids = [self.base_rev_id]
410
                interesting_revision_ids.extend(lcas)
411
                interesting_trees = dict((t.get_revision_id(), t)
412
                    for t in self.this_branch.repository.revision_trees(
413
                        interesting_revision_ids))
414
                self._cached_trees.update(interesting_trees)
415
                self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
416
                sorted_lca_keys = self.revision_graph.find_merge_order(
417
                    revisions[0], lcas)
418
                self._lca_trees = [interesting_trees[key]
419
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
420
            else:
421
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
422
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
423
        self.base_is_other_ancestor = True
3948.1.2 by Vincent Ladeuil
* bzrlib/merge.py:
424
        mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
425
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
426
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
427
        """Set the base revision to use for the merge.
428
429
        :param base_revision: A 2-list containing a path and revision number.
430
        """
1185.12.96 by Aaron Bentley
Merge from mpool
431
        mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
432
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
433
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
434
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
435
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
436
            if base_revision[1] == -1:
437
                self.base_rev_id = base_branch.last_revision()
438
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
439
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
440
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
441
                self.base_rev_id = _mod_revision.ensure_null(
442
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
443
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
444
3008.1.8 by Michael Hudson
extract merger creation into a method
445
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
446
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
447
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
448
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
449
                  'interesting_files': self.interesting_files,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
450
                  'pp': self.pp,
451
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
452
        if self.merge_type.requires_base:
453
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
454
        if self.merge_type.supports_reprocess:
455
            kwargs['reprocess'] = self.reprocess
456
        elif self.reprocess:
1551.6.14 by Aaron Bentley
Tweaks from merge review
457
            raise BzrError("Conflict reduction is not supported for merge"
458
                                  " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
459
        if self.merge_type.supports_show_base:
460
            kwargs['show_base'] = self.show_base
461
        elif self.show_base:
1534.8.2 by Aaron Bentley
Implemented weave merge
462
            raise BzrError("Showing base is not supported for this"
3008.1.14 by Michael Hudson
trivial commit for testing
463
                           " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
464
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
465
            and not self.base_is_other_ancestor):
466
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
467
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
468
            kwargs['cherrypick'] = (not self.base_is_ancestor or
469
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
470
        if self._is_criss_cross and getattr(self.merge_type,
471
                                            'supports_lca_trees', False):
472
            kwargs['lca_trees'] = self._lca_trees
3008.1.8 by Michael Hudson
extract merger creation into a method
473
        return self.merge_type(pb=self._pb,
474
                               change_reporter=self.change_reporter,
475
                               **kwargs)
476
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
477
    def _do_merge_to(self, merge):
4273.1.9 by Aaron Bentley
Cleanup
478
        if self.other_branch is not None:
479
            self.other_branch.update_references(self.this_branch)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
480
        merge.do_merge()
481
        if self.recurse == 'down':
482
            for relpath, file_id in self.this_tree.iter_references():
483
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
484
                other_revision = self.other_tree.get_reference_revision(
485
                    file_id, relpath)
486
                if  other_revision == sub_tree.last_revision():
487
                    continue
488
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
489
                sub_merge.merge_type = self.merge_type
490
                other_branch = self.other_branch.reference_parent(file_id, relpath)
491
                sub_merge.set_other_revision(other_revision, other_branch)
492
                base_revision = self.base_tree.get_reference_revision(file_id)
493
                sub_merge.base_tree = \
494
                    sub_tree.branch.repository.revision_tree(base_revision)
495
                sub_merge.base_rev_id = base_revision
496
                sub_merge.do_merge()
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
497
3008.1.8 by Michael Hudson
extract merger creation into a method
498
    def do_merge(self):
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
499
        self.this_tree.lock_tree_write()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
500
        try:
501
            if self.base_tree is not None:
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
502
                self.base_tree.lock_read()
503
            try:
504
                if self.other_tree is not None:
505
                    self.other_tree.lock_read()
506
                try:
507
                    merge = self.make_merger()
508
                    self._do_merge_to(merge)
509
                finally:
510
                    if self.other_tree is not None:
511
                        self.other_tree.unlock()
512
            finally:
513
                if self.base_tree is not None:
514
                    self.base_tree.unlock()
515
        finally:
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
516
            self.this_tree.unlock()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
517
        if len(merge.cooked_conflicts) == 0:
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
518
            if not self.ignore_zero and not is_quiet():
1534.7.141 by Aaron Bentley
Added conflict reporting
519
                note("All changes applied successfully.")
520
        else:
521
            note("%d conflicts encountered." % len(merge.cooked_conflicts))
522
1534.7.134 by Aaron Bentley
Hid raw conflicts
523
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
524
1545.2.4 by Aaron Bentley
PEP8 fixes
525
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
526
class _InventoryNoneEntry(object):
527
    """This represents an inventory entry which *isn't there*.
528
529
    It simplifies the merging logic if we always have an InventoryEntry, even
530
    if it isn't actually present
531
    """
532
    executable = None
533
    kind = None
534
    name = None
535
    parent_id = None
536
    revision = None
537
    symlink_target = None
538
    text_sha1 = None
539
540
_none_entry = _InventoryNoneEntry()
541
542
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
543
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
544
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
545
    requires_base = True
546
    supports_reprocess = True
547
    supports_show_base = True
548
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
549
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
550
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
551
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
552
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
553
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
554
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
555
                 interesting_ids=None, reprocess=False, show_base=False,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
556
                 pb=DummyProgress(), pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
557
                 interesting_files=None, do_merge=True,
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
558
                 cherrypick=False, lca_trees=None):
2590.2.10 by Aaron Bentley
Updates from review
559
        """Initialize the merger object and perform the merge.
560
561
        :param working_tree: The working tree to apply the merge to
562
        :param this_tree: The local tree in the merge operation
563
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
564
        :param other_tree: The other tree to merge changes from
2590.2.10 by Aaron Bentley
Updates from review
565
        :param interesting_ids: The file_ids of files that should be
566
            participate in the merge.  May not be combined with
567
            interesting_files.
568
        :param: reprocess If True, perform conflict-reduction processing.
569
        :param show_base: If True, show the base revision in text conflicts.
570
            (incompatible with reprocess)
571
        :param pb: A Progress bar
572
        :param pp: A ProgressPhase object
573
        :param change_reporter: An object that should report changes made
574
        :param interesting_files: The tree-relative paths of files that should
575
            participate in the merge.  If these paths refer to directories,
576
            the contents of those directories will also be included.  May not
577
            be combined with interesting_ids.  If neither interesting_files nor
578
            interesting_ids is specified, all files may participate in the
579
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
580
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
581
            if the ancestry was found to include a criss-cross merge.
582
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
583
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
584
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
585
        if interesting_files is not None and interesting_ids is not None:
586
            raise ValueError(
587
                'specify either interesting_ids or interesting_files')
2590.2.4 by Aaron Bentley
Move entry generation to a helper
588
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
589
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
590
        self.this_tree = working_tree
591
        self.base_tree = base_tree
592
        self.other_tree = other_tree
593
        self._raw_conflicts = []
594
        self.cooked_conflicts = []
595
        self.reprocess = reprocess
596
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
597
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
598
        # Uncommenting this will change the default algorithm to always use
599
        # _entries_lca. This can be useful for running the test suite and
600
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
601
        # if lca_trees is None:
602
        #     self._lca_trees = [self.base_tree]
1534.9.1 by Aaron Bentley
Added progress bars to merge
603
        self.pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
604
        self.pp = pp
1551.11.9 by Aaron Bentley
Apply change reporting to merge
605
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
606
        self.cherrypick = cherrypick
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
607
        if self.pp is None:
608
            self.pp = ProgressPhase("Merge phase", 3, self.pb)
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
609
        if do_merge:
610
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
611
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
612
    def do_merge(self):
613
        self.this_tree.lock_tree_write()
614
        self.base_tree.lock_read()
615
        self.other_tree.lock_read()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
616
        try:
4684.1.2 by Gary van der Merwe
In merger, make sure that we unlock the trees if we fail to create a TreeTransform object.
617
            self.tt = TreeTransform(self.this_tree, self.pb)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
618
            try:
4684.1.2 by Gary van der Merwe
In merger, make sure that we unlock the trees if we fail to create a TreeTransform object.
619
                self.pp.next_phase()
620
                self._compute_transform()
621
                self.pp.next_phase()
622
                results = self.tt.apply(no_conflicts=True)
623
                self.write_modified(results)
624
                try:
625
                    self.this_tree.add_conflicts(self.cooked_conflicts)
626
                except UnsupportedOperation:
627
                    pass
628
            finally:
629
                self.tt.finalize()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
630
        finally:
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
631
            self.other_tree.unlock()
632
            self.base_tree.unlock()
633
            self.this_tree.unlock()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
634
            self.pb.clear()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
635
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
636
    def make_preview_transform(self):
637
        self.base_tree.lock_read()
638
        self.other_tree.lock_read()
639
        self.tt = TransformPreview(self.this_tree)
640
        try:
641
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
642
            self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
643
            self.pp.next_phase()
644
        finally:
645
            self.other_tree.unlock()
646
            self.base_tree.unlock()
647
            self.pb.clear()
648
        return self.tt
649
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
650
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
651
        if self._lca_trees is None:
652
            entries = self._entries3()
653
            resolver = self._three_way
654
        else:
655
            entries = self._entries_lca()
656
            resolver = self._lca_multi_way
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
657
        child_pb = ui.ui_factory.nested_progress_bar()
658
        try:
659
            for num, (file_id, changed, parents3, names3,
660
                      executable3) in enumerate(entries):
661
                child_pb.update('Preparing file merge', num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
662
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
663
                if changed:
664
                    file_status = self.merge_contents(file_id)
665
                else:
666
                    file_status = 'unmodified'
667
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
668
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
669
        finally:
670
            child_pb.finished()
671
        self.fix_root()
672
        self.pp.next_phase()
673
        child_pb = ui.ui_factory.nested_progress_bar()
674
        try:
675
            fs_conflicts = resolve_conflicts(self.tt, child_pb,
676
                lambda t, c: conflict_pass(t, c, self.other_tree))
677
        finally:
678
            child_pb.finished()
679
        if self.change_reporter is not None:
680
            from bzrlib import delta
681
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
682
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
683
        self.cook_conflicts(fs_conflicts)
684
        for conflict in self.cooked_conflicts:
685
            warning(conflict)
686
2590.2.4 by Aaron Bentley
Move entry generation to a helper
687
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
688
        """Gather data about files modified between three trees.
689
690
        Return a list of tuples of file_id, changed, parents3, names3,
691
        executable3.  changed is a boolean indicating whether the file contents
692
        or kind were changed.  parents3 is a tuple of parent ids for base,
693
        other and this.  names3 is a tuple of names for base, other and this.
694
        executable3 is a tuple of execute-bit values for base, other and this.
695
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
696
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
697
        iterator = self.other_tree.iter_changes(self.base_tree,
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
698
                include_unchanged=True, specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
699
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
700
        this_entries = dict((e.file_id, e) for p, e in
701
                            self.this_tree.iter_entries_by_dir(
702
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
703
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
704
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
705
            if (self.interesting_ids is not None and
706
                file_id not in self.interesting_ids):
707
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
708
            entry = this_entries.get(file_id)
709
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
710
                this_name = entry.name
711
                this_parent = entry.parent_id
712
                this_executable = entry.executable
713
            else:
714
                this_name = None
715
                this_parent = None
716
                this_executable = None
717
            parents3 = parents + (this_parent,)
718
            names3 = names + (this_name,)
719
            executable3 = executable + (this_executable,)
720
            result.append((file_id, changed, parents3, names3, executable3))
721
        return result
722
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
723
    def _entries_lca(self):
724
        """Gather data about files modified between multiple trees.
725
726
        This compares OTHER versus all LCA trees, and for interesting entries,
727
        it then compares with THIS and BASE.
728
729
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
730
        :return: [(file_id, changed, parents, names, executable)]
731
            file_id     Simple file_id of the entry
732
            changed     Boolean, True if the kind or contents changed
733
                        else False
734
            parents     ((base, [parent_id, in, lcas]), parent_id_other,
735
                         parent_id_this)
736
            names       ((base, [name, in, lcas]), name_in_other, name_in_this)
737
            executable  ((base, [exec, in, lcas]), exec_in_other, exec_in_this)
738
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
739
        if self.interesting_files is not None:
740
            lookup_trees = [self.this_tree, self.base_tree]
741
            lookup_trees.extend(self._lca_trees)
742
            # I think we should include the lca trees as well
743
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
744
                                                        lookup_trees)
745
        else:
746
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
747
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
748
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
749
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
750
        base_inventory = self.base_tree.inventory
751
        this_inventory = self.this_tree.inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
752
        for path, file_id, other_ie, lca_values in walker.iter_all():
753
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
754
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
755
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
756
            if interesting_ids is not None and file_id not in interesting_ids:
757
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
758
3514.4.30 by John Arbash Meinel
Several updates.
759
            # If other_revision is found in any of the lcas, that means this
760
            # node is uninteresting. This is because when merging, if there are
761
            # multiple heads(), we have to create a new node. So if we didn't,
762
            # we know that the ancestry is linear, and that OTHER did not
763
            # modify anything
764
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
765
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
766
            if other_revision is not None:
767
                # We can't use this shortcut when other_revision is None,
768
                # because it may be None because things are WorkingTrees, and
769
                # not because it is *actually* None.
770
                is_unmodified = False
771
                for lca_path, ie in lca_values:
772
                    if ie is not None and ie.revision == other_revision:
773
                        is_unmodified = True
774
                        break
775
                if is_unmodified:
776
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
777
778
            lca_entries = []
779
            for lca_path, lca_ie in lca_values:
780
                if lca_ie is None:
781
                    lca_entries.append(_none_entry)
782
                else:
783
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
784
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
785
            if file_id in base_inventory:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
786
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
787
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
788
                base_ie = _none_entry
789
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
790
            if file_id in this_inventory:
791
                this_ie = this_inventory[file_id]
792
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
793
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
794
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
795
            lca_kinds = []
796
            lca_parent_ids = []
797
            lca_names = []
798
            lca_executable = []
799
            for lca_ie in lca_entries:
800
                lca_kinds.append(lca_ie.kind)
801
                lca_parent_ids.append(lca_ie.parent_id)
802
                lca_names.append(lca_ie.name)
803
                lca_executable.append(lca_ie.executable)
804
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
805
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
806
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
807
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
808
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
809
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
810
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
811
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
812
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
813
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
814
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
815
            content_changed = True
816
            if kind_winner == 'this':
817
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
818
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
819
                    if parent_id_winner == 'this' and name_winner == 'this':
820
                        # No change for this directory in OTHER, skip
821
                        continue
822
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
823
                elif other_ie.kind is None or other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
824
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
825
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
826
                            return None
827
                        return tree.get_file_sha1(file_id)
828
                    base_sha1 = get_sha1(base_ie, self.base_tree)
829
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
830
                                 in zip(lca_entries, self._lca_trees)]
831
                    this_sha1 = get_sha1(this_ie, self.this_tree)
832
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
833
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
834
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
835
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
836
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
837
                        (base_ie.executable, lca_executable),
838
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
839
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
840
                        and sha1_winner == 'this' and exec_winner == 'this'):
841
                        # No kind, parent, name, exec, or content change for
842
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
843
                        continue
844
                    if sha1_winner == 'this':
845
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
846
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
847
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
848
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
849
                            return None
850
                        return tree.get_symlink_target(file_id)
851
                    base_target = get_target(base_ie, self.base_tree)
852
                    lca_targets = [get_target(ie, tree) for ie, tree
853
                                   in zip(lca_entries, self._lca_trees)]
854
                    this_target = get_target(this_ie, self.this_tree)
855
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
856
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
857
                        (base_target, lca_targets),
858
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
859
                    if (parent_id_winner == 'this' and name_winner == 'this'
860
                        and target_winner == 'this'):
861
                        # No kind, parent, name, or symlink target change
862
                        # not interesting
863
                        continue
864
                    if target_winner == 'this':
865
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
866
                elif other_ie.kind == 'tree-reference':
867
                    # The 'changed' information seems to be handled at a higher
868
                    # level. At least, _entries3 returns False for content
869
                    # changed, even when at a new revision_id.
870
                    content_changed = False
871
                    if (parent_id_winner == 'this' and name_winner == 'this'):
872
                        # Nothing interesting
873
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
874
                else:
875
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
876
                # XXX: We need to handle kind == 'symlink'
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
877
878
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
879
            result.append((file_id, content_changed,
880
                           ((base_ie.parent_id, lca_parent_ids),
881
                            other_ie.parent_id, this_ie.parent_id),
882
                           ((base_ie.name, lca_names),
883
                            other_ie.name, this_ie.name),
884
                           ((base_ie.executable, lca_executable),
885
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
886
                          ))
887
        return result
888
889
1731.1.33 by Aaron Bentley
Revert no-special-root changes
890
    def fix_root(self):
891
        try:
892
            self.tt.final_kind(self.tt.root)
893
        except NoSuchFile:
894
            self.tt.cancel_deletion(self.tt.root)
895
        if self.tt.final_file_id(self.tt.root) is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
896
            self.tt.version_file(self.tt.tree_file_id(self.tt.root),
1731.1.33 by Aaron Bentley
Revert no-special-root changes
897
                                 self.tt.root)
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
898
        other_root_file_id = self.other_tree.get_root_id()
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
899
        if other_root_file_id is None:
900
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
901
        other_root = self.tt.trans_id_file_id(other_root_file_id)
902
        if other_root == self.tt.root:
903
            return
904
        try:
905
            self.tt.final_kind(other_root)
906
        except NoSuchFile:
907
            return
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
908
        if self.other_tree.inventory.root.file_id in self.this_tree.inventory:
909
            # the other tree's root is a non-root in the current tree
910
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
911
        self.reparent_children(self.other_tree.inventory.root, self.tt.root)
912
        self.tt.cancel_creation(other_root)
913
        self.tt.cancel_versioning(other_root)
914
915
    def reparent_children(self, ie, target):
916
        for thing, child in ie.children.iteritems():
917
            trans_id = self.tt.trans_id_file_id(child.file_id)
918
            self.tt.adjust_path(self.tt.final_name(trans_id), target, trans_id)
919
1534.7.192 by Aaron Bentley
Record hashes produced by merges
920
    def write_modified(self, results):
921
        modified_hashes = {}
922
        for path in results.modified_paths:
923
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
924
            if file_id is None:
925
                continue
926
            hash = self.this_tree.get_file_sha1(file_id)
927
            if hash is None:
928
                continue
929
            modified_hashes[file_id] = hash
930
        self.this_tree.set_merge_modified(modified_hashes)
931
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
932
    @staticmethod
933
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
934
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
935
        if entry is None:
936
            return None
937
        return entry.parent_id
938
939
    @staticmethod
940
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
941
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
942
        if entry is None:
943
            return None
944
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
945
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
946
    @staticmethod
947
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
948
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
949
        if file_id not in tree:
950
            return None
951
        return tree.get_file_sha1(file_id)
952
953
    @staticmethod
954
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
955
        """Determine the executability of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
956
        if file_id not in tree:
957
            return None
958
        if tree.kind(file_id) != "file":
959
            return False
960
        return tree.is_executable(file_id)
961
962
    @staticmethod
963
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
964
        """Determine the kind of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
965
        if file_id not in tree:
966
            return None
967
        return tree.kind(file_id)
968
969
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
970
    def _three_way(base, other, this):
971
        #if base == other, either they all agree, or only THIS has changed.
972
        if base == other:
973
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
974
        elif this not in (base, other):
2590.2.8 by Aaron Bentley
Restore conflict handling changes
975
            return 'conflict'
2590.2.10 by Aaron Bentley
Updates from review
976
        # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
977
        elif this == other:
978
            return "this"
2590.2.10 by Aaron Bentley
Updates from review
979
        # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
980
        else:
981
            return "other"
982
983
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
984
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
985
        """Consider LCAs when determining whether a change has occurred.
986
987
        If LCAS are all identical, this is the same as a _three_way comparison.
988
989
        :param bases: value in (BASE, [LCAS])
990
        :param other: value in OTHER
991
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
992
        :param allow_overriding_lca: If there is more than one unique lca
993
            value, allow OTHER to override THIS if it has a new value, and
994
            THIS only has an lca value, or vice versa. This is appropriate for
995
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
996
        :return: 'this', 'other', or 'conflict' depending on whether an entry
997
            changed or not.
998
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
999
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1000
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1001
        if other == this:
1002
            # Either Ambiguously clean, or nothing was actually changed. We
1003
            # don't really care
1004
            return 'this'
1005
        base_val, lca_vals = bases
1006
        # Remove 'base_val' from the lca_vals, because it is not interesting
1007
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1008
                                      if lca_val != base_val]
1009
        if len(filtered_lca_vals) == 0:
1010
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1011
1012
        unique_lca_vals = set(filtered_lca_vals)
1013
        if len(unique_lca_vals) == 1:
1014
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1015
1016
        if allow_overriding_lca:
1017
            if other in unique_lca_vals:
1018
                if this in unique_lca_vals:
1019
                    # Each side picked a different lca, conflict
1020
                    return 'conflict'
1021
                else:
1022
                    # This has a value which supersedes both lca values, and
1023
                    # other only has an lca value
1024
                    return 'this'
1025
            elif this in unique_lca_vals:
1026
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1027
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1028
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1029
1030
        # At this point, the lcas disagree, and the tips disagree
1031
        return 'conflict'
1032
1033
    @staticmethod
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1034
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
1035
        """Do a three-way test on a scalar.
1036
        Return "this", "other" or "conflict", depending whether a value wins.
1037
        """
1038
        key_base = key(base_tree, file_id)
1039
        key_other = key(other_tree, file_id)
1040
        #if base == other, either they all agree, or only THIS has changed.
1041
        if key_base == key_other:
1042
            return "this"
1043
        key_this = key(this_tree, file_id)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1044
        # "Ambiguous clean merge"
1045
        if key_this == key_other:
1046
            return "this"
1047
        elif key_this == key_base:
1048
            return "other"
1049
        else:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1050
            return "conflict"
1051
1052
    def merge_names(self, file_id):
1053
        def get_entry(tree):
1054
            if file_id in tree.inventory:
1055
                return tree.inventory[file_id]
1056
            else:
1057
                return None
1058
        this_entry = get_entry(self.this_tree)
1059
        other_entry = get_entry(self.other_tree)
1060
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1061
        entries = (base_entry, other_entry, this_entry)
1062
        names = []
1063
        parents = []
1064
        for entry in entries:
1065
            if entry is None:
1066
                names.append(None)
1067
                parents.append(None)
1068
            else:
1069
                names.append(entry.name)
1070
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1071
        return self._merge_names(file_id, parents, names,
1072
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1073
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1074
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1075
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1076
        base_name, other_name, this_name = names
1077
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1078
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1079
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1080
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1081
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1082
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1083
            if name_winner == "this":
1084
                name_winner = "other"
1085
            if parent_id_winner == "this":
1086
                parent_id_winner = "other"
1087
        if name_winner == "this" and parent_id_winner == "this":
1088
            return
1089
        if name_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1090
            trans_id = self.tt.trans_id_file_id(file_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1091
            self._raw_conflicts.append(('name conflict', trans_id,
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1092
                                        this_name, other_name))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1093
        if parent_id_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1094
            trans_id = self.tt.trans_id_file_id(file_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1095
            self._raw_conflicts.append(('parent conflict', trans_id,
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1096
                                        this_parent, other_parent))
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1097
        if other_name is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1098
            # it doesn't matter whether the result was 'other' or
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1099
            # 'conflict'-- if there's no 'other', we leave it alone.
1100
            return
1101
        # if we get here, name_winner and parent_winner are set to safe values.
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1102
        trans_id = self.tt.trans_id_file_id(file_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1103
        parent_id = parents[self.winner_idx[parent_id_winner]]
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1104
        if parent_id is not None:
1105
            parent_trans_id = self.tt.trans_id_file_id(parent_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1106
            self.tt.adjust_path(names[self.winner_idx[name_winner]],
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1107
                                parent_trans_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1108
1109
    def merge_contents(self, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1110
        """Performs a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1111
        def contents_pair(tree):
1112
            if file_id not in tree:
1113
                return (None, None)
1114
            kind = tree.kind(file_id)
1115
            if kind == "file":
1116
                contents = tree.get_file_sha1(file_id)
1117
            elif kind == "symlink":
1118
                contents = tree.get_symlink_target(file_id)
1119
            else:
1120
                contents = None
1121
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1122
1123
        def contents_conflict():
1124
            trans_id = self.tt.trans_id_file_id(file_id)
1125
            name = self.tt.final_name(trans_id)
1126
            parent_id = self.tt.final_parent(trans_id)
1127
            if file_id in self.this_tree.inventory:
1128
                self.tt.unversion_file(trans_id)
1551.10.2 by Aaron Bentley
Handle merge with dangling inventory entries
1129
                if file_id in self.this_tree:
1130
                    self.tt.delete_contents(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1131
            file_group = self._dump_conflicts(name, parent_id, file_id,
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1132
                                              set_version=True)
1133
            self._raw_conflicts.append(('contents conflict', file_group))
1134
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1135
        # See SPOT run.  run, SPOT, run.
1136
        # So we're not QUITE repeating ourselves; we do tricky things with
1137
        # file kind...
1138
        base_pair = contents_pair(self.base_tree)
1139
        other_pair = contents_pair(self.other_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1140
        if self._lca_trees:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1141
            this_pair = contents_pair(self.this_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1142
            lca_pairs = [contents_pair(tree) for tree in self._lca_trees]
1143
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1144
                                         this_pair, allow_overriding_lca=False)
1145
        else:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1146
            if base_pair == other_pair:
1147
                winner = 'this'
1148
            else:
1149
                # We delayed evaluating this_pair as long as we can to avoid
1150
                # unnecessary sha1 calculation
1151
                this_pair = contents_pair(self.this_tree)
1152
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1153
        if winner == 'this':
1154
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1155
            return "unmodified"
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1156
        trans_id = self.tt.trans_id_file_id(file_id)
1157
        if winner == 'other':
1158
            # OTHER is a straight winner, so replace this contents with other
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1159
            file_in_this = file_id in self.this_tree
1160
            if file_in_this:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1161
                # Remove any existing contents
1162
                self.tt.delete_contents(trans_id)
1163
            if file_id in self.other_tree:
1164
                # OTHER changed the file
1165
                create_from_tree(self.tt, trans_id,
1166
                                 self.other_tree, file_id)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1167
                if not file_in_this:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1168
                    self.tt.version_file(file_id, trans_id)
1169
                return "modified"
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1170
            elif file_in_this:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1171
                # OTHER deleted the file
1172
                self.tt.unversion_file(trans_id)
1173
                return "deleted"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1174
        else:
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1175
            # We have a hypothetical conflict, but if we have files, then we
1176
            # can try to merge the content
1177
            if this_pair[0] == 'file' and other_pair[0] == 'file':
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1178
                # THIS and OTHER are both files, so text merge.  Either
1179
                # BASE is a file, or both converted to files, so at least we
1180
                # have agreement that output should be a file.
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1181
                try:
1182
                    self.text_merge(file_id, trans_id)
1183
                except BinaryFile:
1184
                    return contents_conflict()
3363.17.8 by Aaron Bentley
Get merge into a preview tree working
1185
                if file_id not in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1186
                    self.tt.version_file(file_id, trans_id)
1534.7.152 by Aaron Bentley
Fixed overwrites
1187
                try:
1188
                    self.tt.tree_kind(trans_id)
1189
                    self.tt.delete_contents(trans_id)
1190
                except NoSuchFile:
1191
                    pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1192
                return "modified"
1193
            else:
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1194
                return contents_conflict()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1195
1196
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1197
        """Return the lines in a file, or an empty list."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1198
        if file_id in tree:
1199
            return tree.get_file(file_id).readlines()
1200
        else:
1201
            return []
1202
1203
    def text_merge(self, file_id, trans_id):
1204
        """Perform a three-way text merge on a file_id"""
1205
        # it's possible that we got here with base as a different type.
1206
        # if so, we just want two-way text conflicts.
1207
        if file_id in self.base_tree and \
1208
            self.base_tree.kind(file_id) == "file":
1209
            base_lines = self.get_lines(self.base_tree, file_id)
1210
        else:
1211
            base_lines = []
1212
        other_lines = self.get_lines(self.other_tree, file_id)
1213
        this_lines = self.get_lines(self.this_tree, file_id)
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1214
        m3 = Merge3(base_lines, this_lines, other_lines,
1215
                    is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1216
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1217
        if self.show_base is True:
1218
            base_marker = '|' * 7
1219
        else:
1220
            base_marker = None
1221
1222
        def iter_merge3(retval):
1223
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1224
            for line in m3.merge_lines(name_a = "TREE",
1225
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1226
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1227
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1228
                                       base_marker=base_marker,
1229
                                       reprocess=self.reprocess):
1230
                if line.startswith(start_marker):
1231
                    retval["text_conflicts"] = True
1232
                    yield line.replace(start_marker, '<' * 7)
1233
                else:
1234
                    yield line
1235
        retval = {}
1236
        merge3_iterator = iter_merge3(retval)
1237
        self.tt.create_file(merge3_iterator, trans_id)
1238
        if retval["text_conflicts"] is True:
1239
            self._raw_conflicts.append(('text conflict', trans_id))
1240
            name = self.tt.final_name(trans_id)
1241
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1242
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1243
                                              this_lines, base_lines,
1244
                                              other_lines)
1245
            file_group.append(trans_id)
1246
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1247
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1248
                        base_lines=None, other_lines=None, set_version=False,
1249
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1250
        """Emit conflict files.
1251
        If this_lines, base_lines, or other_lines are omitted, they will be
1252
        determined automatically.  If set_version is true, the .OTHER, .THIS
1253
        or .BASE (in that order) will be created as versioned files.
1254
        """
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1255
        data = [('OTHER', self.other_tree, other_lines),
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1256
                ('THIS', self.this_tree, this_lines)]
1257
        if not no_base:
1258
            data.append(('BASE', self.base_tree, base_lines))
1259
        versioned = False
1260
        file_group = []
1261
        for suffix, tree, lines in data:
1262
            if file_id in tree:
1263
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
1264
                                               suffix, lines)
1265
                file_group.append(trans_id)
1266
                if set_version and not versioned:
1267
                    self.tt.version_file(file_id, trans_id)
1268
                    versioned = True
1269
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1270
3363.17.21 by Aaron Bentley
Conflicts are handled when merging from preview trees
1271
    def _conflict_file(self, name, parent_id, tree, file_id, suffix,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1272
                       lines=None):
1534.7.157 by Aaron Bentley
Added more docs
1273
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1274
        name = name + '.' + suffix
1275
        trans_id = self.tt.create_path(name, parent_id)
3363.17.25 by Aaron Bentley
remove get_inventory_entry, replace with create_from_tree
1276
        create_from_tree(self.tt, trans_id, tree, file_id, lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1277
        return trans_id
1278
1279
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1280
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1281
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1282
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1283
        self._merge_executable(file_id, executable, file_status,
1284
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1285
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1286
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1287
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1288
        """Perform a merge on the execute bit."""
1289
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1290
        if file_status == "deleted":
1291
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1292
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1293
        if winner == "conflict":
1294
        # There must be a None in here, if we have a conflict, but we
1295
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1296
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1297
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1298
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1299
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1300
        if winner == 'this' and file_status != "modified":
1301
            return
1302
        trans_id = self.tt.trans_id_file_id(file_id)
1303
        try:
1304
            if self.tt.final_kind(trans_id) != "file":
1305
                return
1306
        except NoSuchFile:
1307
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1308
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1309
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1310
        else:
1311
            if file_id in self.other_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1312
                executability = other_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1313
            elif file_id in self.this_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1314
                executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1315
            elif file_id in self.base_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1316
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1317
        if executability is not None:
1318
            trans_id = self.tt.trans_id_file_id(file_id)
1319
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1320
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1321
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1322
        """Convert all conflicts into a form that doesn't depend on trans_id"""
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1323
        from conflicts import Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1324
        name_conflicts = {}
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1325
        self.cooked_conflicts.extend(cook_conflicts(fs_conflicts, self.tt))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1326
        fp = FinalPaths(self.tt)
1327
        for conflict in self._raw_conflicts:
1328
            conflict_type = conflict[0]
1329
            if conflict_type in ('name conflict', 'parent conflict'):
1330
                trans_id = conflict[1]
1331
                conflict_args = conflict[2:]
1332
                if trans_id not in name_conflicts:
1333
                    name_conflicts[trans_id] = {}
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1334
                unique_add(name_conflicts[trans_id], conflict_type,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1335
                           conflict_args)
1336
            if conflict_type == 'contents conflict':
1337
                for trans_id in conflict[1]:
1338
                    file_id = self.tt.final_file_id(trans_id)
1339
                    if file_id is not None:
1340
                        break
1341
                path = fp.get_path(trans_id)
1342
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1343
                    if path.endswith(suffix):
1344
                        path = path[:-len(suffix)]
1345
                        break
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1346
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1347
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1348
            if conflict_type == 'text conflict':
1349
                trans_id = conflict[1]
1350
                path = fp.get_path(trans_id)
1351
                file_id = self.tt.final_file_id(trans_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1352
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1353
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1354
1355
        for trans_id, conflicts in name_conflicts.iteritems():
1356
            try:
1357
                this_parent, other_parent = conflicts['parent conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1358
                if this_parent == other_parent:
1359
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1360
            except KeyError:
1361
                this_parent = other_parent = \
1362
                    self.tt.final_file_id(self.tt.final_parent(trans_id))
1363
            try:
1364
                this_name, other_name = conflicts['name conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1365
                if this_name == other_name:
1366
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1367
            except KeyError:
1368
                this_name = other_name = self.tt.final_name(trans_id)
1369
            other_path = fp.get_path(trans_id)
1551.16.2 by Aaron Bentley
Don't crash on merging renamed deleted files (#110279)
1370
            if this_parent is not None and this_name is not None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1371
                this_parent_path = \
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1372
                    fp.get_path(self.tt.trans_id_file_id(this_parent))
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1373
                this_path = pathjoin(this_parent_path, this_name)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1374
            else:
1375
                this_path = "<deleted>"
1376
            file_id = self.tt.final_file_id(trans_id)
1534.10.20 by Aaron Bentley
Got all tests passing
1377
            c = Conflict.factory('path conflict', path=this_path,
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1378
                                 conflict_path=other_path, file_id=file_id)
1379
            self.cooked_conflicts.append(c)
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
1380
        self.cooked_conflicts.sort(key=Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1381
1382
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1383
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1384
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1385
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1386
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1387
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1388
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1389
1390
    def _merged_lines(self, file_id):
1391
        """Generate the merged lines.
1392
        There is no distinction between lines that are meant to contain <<<<<<<
1393
        and conflicts.
1394
        """
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1395
        if self.cherrypick:
1396
            base = self.base_tree
1397
        else:
1398
            base = None
3062.2.4 by Aaron Bentley
Start supporting merge-with-base
1399
        plan = self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1400
                                              base=base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1401
        if 'merge' in debug.debug_flags:
1402
            plan = list(plan)
1403
            trans_id = self.tt.trans_id_file_id(file_id)
1404
            name = self.tt.final_name(trans_id) + '.plan'
1405
            contents = ('%10s|%s' % l for l in plan)
1406
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1551.15.52 by Aaron Bentley
Tweak from review comments
1407
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1408
            '>>>>>>> MERGE-SOURCE\n')
1409
        return textmerge.merge_lines(self.reprocess)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1410
1411
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1412
        """Perform a (weave) text merge for a given file and file-id.
1413
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1414
        and a conflict will be noted.
1415
        """
1551.6.12 by Aaron Bentley
Indicate conflicts from merge_lines, insead of guessing
1416
        lines, conflicts = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1417
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1418
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1419
        # because we don't want to get into weave merge guts.
1420
        check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1421
        self.tt.create_file(lines, trans_id)
1422
        if conflicts:
1423
            self._raw_conflicts.append(('text conflict', trans_id))
1424
            name = self.tt.final_name(trans_id)
1425
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1426
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1427
                                              no_base=True)
1428
            file_group.append(trans_id)
1429
1430
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1431
class LCAMerger(WeaveMerger):
1432
1433
    def _merged_lines(self, file_id):
1434
        """Generate the merged lines.
1435
        There is no distinction between lines that are meant to contain <<<<<<<
1436
        and conflicts.
1437
        """
1438
        if self.cherrypick:
1439
            base = self.base_tree
1440
        else:
1441
            base = None
1442
        plan = self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
1443
                                                  base=base)
1444
        if 'merge' in debug.debug_flags:
1445
            plan = list(plan)
1446
            trans_id = self.tt.trans_id_file_id(file_id)
1447
            name = self.tt.final_name(trans_id) + '.plan'
1448
            contents = ('%10s|%s' % l for l in plan)
1449
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1450
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1451
            '>>>>>>> MERGE-SOURCE\n')
1452
        return textmerge.merge_lines(self.reprocess)
1453
1454
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1455
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1456
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1457
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1458
    def dump_file(self, temp_dir, name, tree, file_id):
1459
        out_path = pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1460
        out_file = open(out_path, "wb")
1461
        try:
1462
            in_file = tree.get_file(file_id)
1463
            for line in in_file:
1464
                out_file.write(line)
1465
        finally:
1466
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1467
        return out_path
1468
1469
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1470
        """Perform a diff3 merge using a specified file-id and trans-id.
1471
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1472
        will be dumped, and a will be conflict noted.
1473
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1474
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1475
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1476
        try:
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1477
            new_file = pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1478
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1479
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1480
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1481
            status = bzrlib.patch.diff3(new_file, this, base, other)
1482
            if status not in (0, 1):
1483
                raise BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1484
            f = open(new_file, 'rb')
1485
            try:
1486
                self.tt.create_file(f, trans_id)
1487
            finally:
1488
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1489
            if status == 1:
1490
                name = self.tt.final_name(trans_id)
1491
                parent_id = self.tt.final_parent(trans_id)
1492
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1493
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1494
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1495
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1496
1497
1498
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1499
                backup_files=False,
1500
                merge_type=Merge3Merger,
1501
                interesting_ids=None,
1502
                show_base=False,
1503
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1504
                other_rev_id=None,
1505
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1506
                this_tree=None,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1507
                pb=DummyProgress(),
1508
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1509
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1510
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1511
        typical use is probably
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1512
        'merge_inner(branch, branch.get_revision_tree(other_revision),
1513
                     branch.get_revision_tree(base_revision))'
1514
        """
1515
    if this_tree is None:
2367.2.1 by Robert Collins
Remove bzrlib 0.8 compatability where it was making the code unclear or messy. (Robert Collins)
1516
        raise BzrError("bzrlib.merge.merge_inner requires a this_tree "
1517
            "parameter as of bzrlib version 0.8.")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1518
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1519
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1520
    merger.backup_files = backup_files
1521
    merger.merge_type = merge_type
1522
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1523
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1524
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1525
        if interesting_ids:
1526
            raise ValueError('Only supply interesting_ids'
1527
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1528
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1529
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1530
    merger.reprocess = reprocess
1531
    merger.other_rev_id = other_rev_id
1532
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1533
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1534
    if get_revision_id is None:
1535
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1536
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1537
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1538
    return merger.do_merge()
1539
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1540
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1541
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1542
1543
    This method provides a sanctioned way to retrieve it.
1544
    """
1545
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1546
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1547
1548
1549
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1550
    def status_a(revision, text):
1551
        if revision in ancestors_b:
1552
            return 'killed-b', text
1553
        else:
1554
            return 'new-a', text
1555
1556
    def status_b(revision, text):
1557
        if revision in ancestors_a:
1558
            return 'killed-a', text
1559
        else:
1560
            return 'new-b', text
1561
1562
    plain_a = [t for (a, t) in annotated_a]
1563
    plain_b = [t for (a, t) in annotated_b]
1564
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1565
    blocks = matcher.get_matching_blocks()
1566
    a_cur = 0
1567
    b_cur = 0
1568
    for ai, bi, l in blocks:
1569
        # process all mismatched sections
1570
        # (last mismatched section is handled because blocks always
1571
        # includes a 0-length last block)
1572
        for revision, text in annotated_a[a_cur:ai]:
1573
            yield status_a(revision, text)
1574
        for revision, text in annotated_b[b_cur:bi]:
1575
            yield status_b(revision, text)
1576
        # and now the matched section
1577
        a_cur = ai + l
1578
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
1579
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
1580
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1581
1582
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1583
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1584
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1585
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1586
        """Contructor.
1587
1588
        :param a_rev: Revision-id of one revision to merge
1589
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1590
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1591
        :param key_prefix: A prefix for accessing keys in vf, typically
1592
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1593
        """
1594
        self.a_rev = a_rev
1595
        self.b_rev = b_rev
1596
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
1597
        self._last_lines = None
1598
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
1599
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1600
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1601
        self._precache_tip_lines()
1602
1603
    def _precache_tip_lines(self):
1604
        lines = self.get_lines([self.a_rev, self.b_rev])
1605
        self.lines_a = lines[self.a_rev]
1606
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1607
1608
    def get_lines(self, revisions):
1609
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
1610
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1611
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1612
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1613
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1614
        result = {}
1615
        for record in self.vf.get_record_stream(keys, 'unordered', True):
1616
            if record.storage_kind == 'absent':
1617
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
1618
            result[record.key[-1]] = osutils.chunks_to_lines(
1619
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1620
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1621
1622
    def plan_merge(self):
1623
        """Generate a 'plan' for merging the two revisions.
1624
1625
        This involves comparing their texts and determining the cause of
1626
        differences.  If text A has a line and text B does not, then either the
1627
        line was added to text A, or it was deleted from B.  Once the causes
1628
        are combined, they are written out in the format described in
1629
        VersionedFile.plan_merge
1630
        """
1631
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1632
        unique_a, unique_b = self._unique_lines(blocks)
1633
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
1634
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
1635
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
1636
1637
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1638
        last_i = 0
1639
        last_j = 0
1640
        for i, j, n in blocks:
1641
            for a_index in range(last_i, i):
1642
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
1643
                    if a_index in killed_b:
1644
                        yield 'conflicted-a', self.lines_a[a_index]
1645
                    else:
1646
                        yield 'new-a', self.lines_a[a_index]
1647
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1648
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1649
            for b_index in range(last_j, j):
1650
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
1651
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
1652
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
1653
                    else:
1654
                        yield 'new-b', self.lines_b[b_index]
1655
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1656
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1657
            # handle common lines
1658
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1659
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1660
            last_i = i+n
1661
            last_j = j+n
1662
1663
    def _get_matching_blocks(self, left_revision, right_revision):
1664
        """Return a description of which sections of two revisions match.
1665
1666
        See SequenceMatcher.get_matching_blocks
1667
        """
3144.3.7 by Aaron Bentley
Update from review
1668
        cached = self._cached_matching_blocks.get((left_revision,
1669
                                                   right_revision))
1670
        if cached is not None:
1671
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
1672
        if self._last_lines_revision_id == left_revision:
1673
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1674
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1675
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1676
            lines = self.get_lines([left_revision, right_revision])
1677
            left_lines = lines[left_revision]
1678
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1679
        self._last_lines = right_lines
1680
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1681
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
1682
                                                       right_lines)
1683
        return matcher.get_matching_blocks()
1684
1685
    def _unique_lines(self, matching_blocks):
1686
        """Analyse matching_blocks to determine which lines are unique
1687
1688
        :return: a tuple of (unique_left, unique_right), where the values are
1689
            sets of line numbers of unique lines.
1690
        """
1691
        last_i = 0
1692
        last_j = 0
1693
        unique_left = []
1694
        unique_right = []
1695
        for i, j, n in matching_blocks:
1696
            unique_left.extend(range(last_i, i))
1697
            unique_right.extend(range(last_j, j))
1698
            last_i = i + n
1699
            last_j = j + n
1700
        return unique_left, unique_right
1701
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1702
    @staticmethod
1703
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
1704
        """Remove changes from new_plan that came from old_plan.
1705
1706
        It is assumed that the difference between the old_plan and new_plan
1707
        is their choice of 'b' text.
1708
1709
        All lines from new_plan that differ from old_plan are emitted
1710
        verbatim.  All lines from new_plan that match old_plan but are
1711
        not about the 'b' revision are emitted verbatim.
1712
1713
        Lines that match and are about the 'b' revision are the lines we
1714
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
1715
        is skipped entirely.
1716
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1717
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
1718
                                                       new_plan)
1719
        last_j = 0
1720
        for i, j, n in matcher.get_matching_blocks():
1721
            for jj in range(last_j, j):
1722
                yield new_plan[jj]
1723
            for jj in range(j, j+n):
1724
                plan_line = new_plan[jj]
1725
                if plan_line[0] == 'new-b':
1726
                    pass
1727
                elif plan_line[0] == 'killed-b':
1728
                    yield 'unchanged', plan_line[1]
1729
                else:
1730
                    yield plan_line
1731
            last_j = j + n
1732
1733
1734
class _PlanMerge(_PlanMergeBase):
1735
    """Plan an annotate merge using on-the-fly annotation"""
1736
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1737
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1738
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
1739
        self.a_key = self._key_prefix + (self.a_rev,)
1740
        self.b_key = self._key_prefix + (self.b_rev,)
1741
        self.graph = Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
1742
        heads = self.graph.heads((self.a_key, self.b_key))
1743
        if len(heads) == 1:
1744
            # one side dominates, so we can just return its values, yay for
1745
            # per-file graphs
1746
            # Ideally we would know that before we get this far
1747
            self._head_key = heads.pop()
1748
            if self._head_key == self.a_key:
1749
                other = b_rev
1750
            else:
1751
                other = a_rev
1752
            mutter('found dominating revision for %s\n%s > %s', self.vf,
1753
                   self._head_key[-1], other)
1754
            self._weave = None
1755
        else:
1756
            self._head_key = None
1757
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1758
1759
    def _precache_tip_lines(self):
1760
        # Turn this into a no-op, because we will do this later
1761
        pass
1762
1763
    def _find_recursive_lcas(self):
1764
        """Find all the ancestors back to a unique lca"""
1765
        cur_ancestors = (self.a_key, self.b_key)
1766
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1767
        # rather than a key tuple. We will just map that directly to no common
1768
        # ancestors.
1769
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1770
        while True:
1771
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1772
            # Map a plain NULL_REVISION to a simple no-ancestors
1773
            if next_lcas == set([NULL_REVISION]):
1774
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1775
            # Order the lca's based on when they were merged into the tip
1776
            # While the actual merge portion of weave merge uses a set() of
1777
            # active revisions, the order of insertion *does* effect the
1778
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1779
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1780
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
1781
                                                                    next_lcas))
1782
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1783
            if len(next_lcas) == 0:
1784
                break
1785
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1786
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1787
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
1788
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1789
                # More than 2 lca's, fall back to grabbing all nodes between
1790
                # this and the unique lca.
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
1791
                mutter('More than 2 LCAs, falling back to all nodes for:'
1792
                       ' %s, %s\n=> %s', self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1793
                cur_lcas = next_lcas
1794
                while len(cur_lcas) > 1:
1795
                    cur_lcas = self.graph.find_lca(*cur_lcas)
1796
                if len(cur_lcas) == 0:
1797
                    # No common base to find, use the full ancestry
1798
                    unique_lca = None
1799
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1800
                    unique_lca = list(cur_lcas)[0]
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1801
                    if unique_lca == NULL_REVISION:
1802
                        # find_lca will return a plain 'NULL_REVISION' rather
1803
                        # than a key tuple when there is no common ancestor, we
1804
                        # prefer to just use None, because it doesn't confuse
1805
                        # _get_interesting_texts()
1806
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1807
                parent_map.update(self._find_unique_parents(next_lcas,
1808
                                                            unique_lca))
1809
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1810
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1811
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1812
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1813
    def _find_unique_parents(self, tip_keys, base_key):
1814
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1815
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1816
        :param tip_keys: Nodes that are interesting
1817
        :param base_key: Cull all ancestors of this node
1818
        :return: The parent map for all revisions between tip_keys and
1819
            base_key. base_key will be included. References to nodes outside of
1820
            the ancestor set will also be removed.
1821
        """
1822
        # TODO: this would be simpler if find_unique_ancestors took a list
1823
        #       instead of a single tip, internally it supports it, but it
1824
        #       isn't a "backwards compatible" api change.
1825
        if base_key is None:
1826
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1827
            # We remove NULL_REVISION because it isn't a proper tuple key, and
1828
            # thus confuses things like _get_interesting_texts, and our logic
1829
            # to add the texts into the memory weave.
1830
            if NULL_REVISION in parent_map:
1831
                parent_map.pop(NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1832
        else:
1833
            interesting = set()
1834
            for tip in tip_keys:
1835
                interesting.update(
1836
                    self.graph.find_unique_ancestors(tip, [base_key]))
1837
            parent_map = self.graph.get_parent_map(interesting)
1838
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1839
        culled_parent_map, child_map, tails = self._remove_external_references(
1840
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1841
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1842
        if base_key is not None:
1843
            tails.remove(base_key)
1844
            self._prune_tails(culled_parent_map, child_map, tails)
1845
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
1846
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
1847
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1848
1849
    @staticmethod
1850
    def _remove_external_references(parent_map):
1851
        """Remove references that go outside of the parent map.
1852
1853
        :param parent_map: Something returned from Graph.get_parent_map(keys)
1854
        :return: (filtered_parent_map, child_map, tails)
1855
            filtered_parent_map is parent_map without external references
1856
            child_map is the {parent_key: [child_keys]} mapping
1857
            tails is a list of nodes that do not have any parents in the map
1858
        """
1859
        # TODO: The basic effect of this function seems more generic than
1860
        #       _PlanMerge. But the specific details of building a child_map,
1861
        #       and computing tails seems very specific to _PlanMerge.
1862
        #       Still, should this be in Graph land?
1863
        filtered_parent_map = {}
1864
        child_map = {}
1865
        tails = []
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1866
        for key, parent_keys in parent_map.iteritems():
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1867
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
1868
            if not culled_parent_keys:
1869
                tails.append(key)
1870
            for parent_key in culled_parent_keys:
1871
                child_map.setdefault(parent_key, []).append(key)
1872
            # TODO: Do we want to do this, it adds overhead for every node,
1873
            #       just to say that the node has no children
1874
            child_map.setdefault(key, [])
1875
            filtered_parent_map[key] = culled_parent_keys
1876
        return filtered_parent_map, child_map, tails
1877
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1878
    @staticmethod
1879
    def _prune_tails(parent_map, child_map, tails_to_remove):
1880
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1881
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1882
        This will remove the supplied revisions until no more children have 0
1883
        parents.
1884
1885
        :param parent_map: A dict of {child: [parents]}, this dictionary will
1886
            be modified in place.
1887
        :param tails_to_remove: A list of tips that should be removed,
1888
            this list will be consumed
1889
        :param child_map: The reverse dict of parent_map ({parent: [children]})
1890
            this dict will be modified
1891
        :return: None, parent_map will be modified in place.
1892
        """
1893
        while tails_to_remove:
1894
            next = tails_to_remove.pop()
1895
            parent_map.pop(next)
1896
            children = child_map.pop(next)
1897
            for child in children:
1898
                child_parents = parent_map[child]
1899
                child_parents.remove(next)
1900
                if len(child_parents) == 0:
1901
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1902
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1903
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1904
        """Return a dict of texts we are interested in.
1905
1906
        Note that the input is in key tuples, but the output is in plain
1907
        revision ids.
1908
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1909
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1910
        :return: A dict of {'revision_id':lines} as returned by
1911
            _PlanMergeBase.get_lines()
1912
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1913
        all_revision_keys = set(parent_map)
1914
        all_revision_keys.add(self.a_key)
1915
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1916
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1917
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
1918
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1919
        return all_texts
1920
1921
    def _build_weave(self):
1922
        from bzrlib import weave
1923
        self._weave = weave.Weave(weave_name='in_memory_weave',
1924
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1925
        parent_map = self._find_recursive_lcas()
1926
1927
        all_texts = self._get_interesting_texts(parent_map)
1928
1929
        # Note: Unfortunately, the order given by topo_sort will effect the
1930
        # ordering resolution in the output. Specifically, if you add A then B,
1931
        # then in the output text A lines will show up before B lines. And, of
1932
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1933
        # So we use merge_sort, and add a fake node on the tip.
1934
        # This ensures that left-hand parents will always be inserted into the
1935
        # weave before right-hand parents.
1936
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
1937
        parent_map[tip_key] = (self.a_key, self.b_key)
1938
1939
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
1940
                                                                  tip_key)):
1941
            if key == tip_key:
1942
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1943
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1944
            parent_keys = parent_map[key]
1945
            revision_id = key[-1]
1946
            parent_ids = [k[-1] for k in parent_keys]
1947
            self._weave.add_lines(revision_id, parent_ids,
1948
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1949
1950
    def plan_merge(self):
1951
        """Generate a 'plan' for merging the two revisions.
1952
1953
        This involves comparing their texts and determining the cause of
1954
        differences.  If text A has a line and text B does not, then either the
1955
        line was added to text A, or it was deleted from B.  Once the causes
1956
        are combined, they are written out in the format described in
1957
        VersionedFile.plan_merge
1958
        """
1959
        if self._head_key is not None: # There was a single head
1960
            if self._head_key == self.a_key:
1961
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1962
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1963
                if self._head_key != self.b_key:
1964
                    raise AssertionError('There was an invalid head: %s != %s'
1965
                                         % (self.b_key, self._head_key))
1966
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
1967
            head_rev = self._head_key[-1]
1968
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1969
            return ((plan, line) for line in lines)
1970
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
1971
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1972
1973
class _PlanLCAMerge(_PlanMergeBase):
1974
    """
3144.3.7 by Aaron Bentley
Update from review
1975
    This merge algorithm differs from _PlanMerge in that:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1976
    1. comparisons are done against LCAs only
1977
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
1978
       another are marked as conflicts, by emitting the line as conflicted-a
1979
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1980
1981
    This is faster, and hopefully produces more useful output.
1982
    """
1983
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1984
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
1985
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
1986
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
1987
        self.lcas = set()
1988
        for lca in lcas:
1989
            if lca == NULL_REVISION:
1990
                self.lcas.add(lca)
1991
            else:
1992
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
1993
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
1994
            if _mod_revision.is_null(lca):
1995
                lca_lines = []
1996
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
1997
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
1998
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
1999
                                                           lca_lines)
2000
            blocks = list(matcher.get_matching_blocks())
2001
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2002
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2003
                                                           lca_lines)
2004
            blocks = list(matcher.get_matching_blocks())
2005
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2006
3144.3.7 by Aaron Bentley
Update from review
2007
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2008
        """Determines the status unique lines versus all lcas.
2009
2010
        Basically, determines why the line is unique to this revision.
2011
2012
        A line may be determined new, killed, or both.
2013
3144.3.7 by Aaron Bentley
Update from review
2014
        If a line is determined new, that means it was not present in at least
2015
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2016
2017
        If a line is determined killed, that means the line was present in
2018
        at least one LCA.
2019
2020
        If a line is killed and new, this indicates that the two merge
2021
        revisions contain differing conflict resolutions.
3144.3.7 by Aaron Bentley
Update from review
2022
        :param revision_id: The id of the revision in which the lines are
2023
            unique
2024
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2025
        :return a tuple of (new_this, killed_other):
2026
        """
2027
        new = set()
2028
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2029
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2030
        for lca in self.lcas:
2031
            blocks = self._get_matching_blocks(revision_id, lca)
2032
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2033
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2034
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2035
        return new, killed