/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1
# Copyright (C) 2005, 2006, 2008 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
17
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
18
import errno
19
from itertools import chain
1185.1.2 by Martin Pool
- merge various windows and other fixes from Ollie Rutherfurd
20
import os
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
21
import warnings
1113 by Martin Pool
- fix is_ancestor import problem in merge
22
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
23
from bzrlib import (
1551.19.17 by Aaron Bentley
Add debugging flag for merges
24
    debug,
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
25
    errors,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
26
    graph as _mod_graph,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
27
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
28
    patiencediff,
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
29
    registry,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
30
    revision as _mod_revision,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
31
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
32
    tsort,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
33
    )
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
34
from bzrlib.branch import Branch
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
35
from bzrlib.conflicts import ConflictList, Conflict
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
36
from bzrlib.errors import (BzrCommandError,
1534.4.28 by Robert Collins
first cut at merge from integration.
37
                           BzrError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
38
                           NoCommonAncestor,
39
                           NoCommits,
1534.4.28 by Robert Collins
first cut at merge from integration.
40
                           NoSuchRevision,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
41
                           NoSuchFile,
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
42
                           NotBranchError,
1185.33.27 by Martin Pool
[merge] much integrated work from robert and john
43
                           NotVersionedError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
44
                           UnrelatedBranches,
1534.10.12 by Aaron Bentley
Merge produces new conflicts
45
                           UnsupportedOperation,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
46
                           WorkingTreeNotRevision,
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
47
                           BinaryFile,
1534.4.28 by Robert Collins
first cut at merge from integration.
48
                           )
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
49
from bzrlib.graph import Graph
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
50
from bzrlib.merge3 import Merge3
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
51
from bzrlib.osutils import rename, pathjoin
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
52
from progress import DummyProgress, ProgressPhase
3052.1.3 by John Arbash Meinel
deprecate revision.is_ancestor, update the callers and the tests.
53
from bzrlib.revision import (NULL_REVISION, ensure_null)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
54
from bzrlib.textfile import check_text_lines
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
55
from bzrlib.trace import mutter, warning, note, is_quiet
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
56
from bzrlib.transform import (TransformPreview, TreeTransform,
57
                              resolve_conflicts, cook_conflicts,
2590.2.8 by Aaron Bentley
Restore conflict handling changes
58
                              conflict_pass, FinalPaths, create_by_entry,
59
                              unique_add, ROOT_PARENT)
1551.15.46 by Aaron Bentley
Move plan merge to tree
60
from bzrlib.versionedfile import PlanWeaveMerge
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
61
from bzrlib import ui
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
62
63
# TODO: Report back as changes are merged in
64
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
65
1185.35.4 by Aaron Bentley
Implemented remerge
66
def transform_tree(from_tree, to_tree, interesting_ids=None):
67
    merge_inner(from_tree.branch, to_tree, from_tree, ignore_zero=True,
1558.1.3 by Aaron Bentley
Fixed deprecated op use in test suite
68
                interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
69
1457.1.12 by Robert Collins
Update comment to reflect author.
70
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
71
class Merger(object):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
72
    def __init__(self, this_branch, other_tree=None, base_tree=None,
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
73
                 this_tree=None, pb=DummyProgress(), change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
74
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
75
        object.__init__(self)
76
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
77
        self.this_basis = _mod_revision.ensure_null(
78
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
79
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
80
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
81
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
82
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
83
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
84
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
85
        self.base_tree = base_tree
86
        self.ignore_zero = False
87
        self.backup_files = False
88
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
89
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
90
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
91
        self.reprocess = False
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
92
        self._pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
93
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
94
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
95
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
96
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
97
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
98
        self._base_is_ancestor = None
99
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
100
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
101
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
102
103
    @property
104
    def revision_graph(self):
105
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
106
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
107
        return self._revision_graph
108
109
    def _set_base_is_ancestor(self, value):
110
        self._base_is_ancestor = value
111
112
    def _get_base_is_ancestor(self):
113
        if self._base_is_ancestor is None:
114
            self._base_is_ancestor = self.revision_graph.is_ancestor(
115
                self.base_rev_id, self.this_basis)
116
        return self._base_is_ancestor
117
118
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
119
120
    def _set_base_is_other_ancestor(self, value):
121
        self._base_is_other_ancestor = value
122
123
    def _get_base_is_other_ancestor(self):
124
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
125
            if self.other_basis is None:
126
                return True
127
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
128
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
129
        return self._base_is_other_ancestor
130
131
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
132
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
133
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
134
    @staticmethod
135
    def from_uncommitted(tree, other_tree, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
136
        """Return a Merger for uncommitted changes in other_tree.
137
138
        :param tree: The tree to merge into
139
        :param other_tree: The tree to get uncommitted changes from
140
        :param pb: A progress indicator
141
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
142
        merger = Merger(tree.branch, other_tree, other_tree.basis_tree(), tree,
143
                        pb)
144
        merger.base_rev_id = merger.base_tree.get_revision_id()
145
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
146
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
147
        return merger
148
149
    @classmethod
150
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
151
        """Return a Merger for a bundle or merge directive.
152
153
        :param tree: The tree to merge changes into
154
        :param mergeable: A merge directive or bundle
155
        :param pb: A progress indicator
156
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
157
        mergeable.install_revisions(tree.branch.repository)
158
        base_revision_id, other_revision_id, verified =\
159
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
160
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
161
        if base_revision_id is not None:
162
            if (base_revision_id != _mod_revision.NULL_REVISION and
163
                revision_graph.is_ancestor(
164
                base_revision_id, tree.branch.last_revision())):
165
                base_revision_id = None
166
            else:
167
                warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
168
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
169
                                         base_revision_id, revision_graph=
170
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
171
        return merger, verified
172
173
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
174
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
175
                          base_branch=None, revision_graph=None):
1551.15.74 by Aaron Bentley
Textual updates from review
176
        """Return a Merger for revision-ids.
177
178
        :param tree: The tree to merge changes into
179
        :param other: The revision-id to use as OTHER
180
        :param base: The revision-id to use as BASE.  If not specified, will
181
            be auto-selected.
182
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
183
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
184
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
185
            not supplied, other_branch or tree.branch will be used.
186
        :param revision_graph: If you have a revision_graph precomputed, pass
187
            it in, otherwise it will be created for you.
1551.15.74 by Aaron Bentley
Textual updates from review
188
        :param pb: A progress indicator
189
        """
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
190
        merger = Merger(tree.branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
191
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
192
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
193
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
194
        merger.set_other_revision(other, other_branch)
195
        if base is None:
196
            merger.find_base()
197
        else:
198
            if base_branch is None:
199
                base_branch = other_branch
200
            merger.set_base_revision(base, base_branch)
201
        return merger
202
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
203
    def revision_tree(self, revision_id, branch=None):
204
        if revision_id not in self._cached_trees:
205
            if branch is None:
206
                branch = self.this_branch
207
            try:
208
                tree = self.this_tree.revision_tree(revision_id)
209
            except errors.NoSuchRevisionInTree:
210
                tree = branch.repository.revision_tree(revision_id)
211
            self._cached_trees[revision_id] = tree
212
        return self._cached_trees[revision_id]
213
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
214
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
215
        from bzrlib import workingtree
216
        location, revno = treespec
217
        if revno is None:
218
            tree = workingtree.WorkingTree.open_containing(location)[0]
219
            return tree.branch, tree
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
220
        branch = Branch.open_containing(location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
221
        if revno == -1:
222
            revision_id = branch.last_revision()
223
        else:
224
            revision_id = branch.get_rev_id(revno)
225
        revision_id = ensure_null(revision_id)
226
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
227
228
    def ensure_revision_trees(self):
229
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
230
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
231
            if self.this_basis == self.this_rev_id:
232
                self.this_revision_tree = self.this_basis_tree
233
1185.12.83 by Aaron Bentley
Preliminary weave merge support
234
        if self.other_rev_id is None:
235
            other_basis_tree = self.revision_tree(self.other_basis)
1852.10.3 by Robert Collins
Remove all uses of compare_trees and replace with Tree.changes_from throughout bzrlib.
236
            changes = other_basis_tree.changes_from(self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
237
            if changes.has_changed():
238
                raise WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
239
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
240
            self.other_tree = other_basis_tree
241
242
    def file_revisions(self, file_id):
243
        self.ensure_revision_trees()
244
        def get_id(tree, file_id):
245
            revision_id = tree.inventory[file_id].revision
246
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
247
        if self.this_rev_id is None:
248
            if self.this_basis_tree.get_file_sha1(file_id) != \
249
                self.this_tree.get_file_sha1(file_id):
250
                raise WorkingTreeNotRevision(self.this_tree)
251
252
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
253
        return [get_id(tree, file_id) for tree in trees]
254
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
255
    def check_basis(self, check_clean, require_commits=True):
256
        if self.this_basis is None and require_commits is True:
2249.3.1 by John Arbash Meinel
Mention using 'bzr pull' if there are no commits in current branch
257
            raise BzrCommandError("This branch has no commits."
258
                                  " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
259
        if check_clean:
260
            self.compare_basis()
261
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
262
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
263
264
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
265
        try:
266
            basis_tree = self.revision_tree(self.this_tree.last_revision())
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
267
        except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
268
            basis_tree = self.this_tree.basis_tree()
269
        changes = self.this_tree.changes_from(basis_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
270
        if not changes.has_changed():
271
            self.this_rev_id = self.this_basis
272
273
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
274
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
275
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
276
    def set_pending(self):
2644.1.1 by Wouter van Heyst
Fix bug #127115 by checking for self.other_rev_id being None in Merger.set_pending()
277
        if not self.base_is_ancestor or not self.base_is_other_ancestor or self.other_rev_id is None:
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
278
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
279
        self._add_parent()
280
281
    def _add_parent(self):
282
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
283
        new_parent_trees = []
284
        for revision_id in new_parents:
285
            try:
286
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
287
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
288
                tree = None
289
            else:
290
                tree.lock_read()
291
            new_parent_trees.append((revision_id, tree))
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
292
        try:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
293
            self.this_tree.set_parent_trees(new_parent_trees,
294
                                            allow_leftmost_as_ghost=True)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
295
        finally:
296
            for _revision_id, tree in new_parent_trees:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
297
                if tree is not None:
298
                    tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
299
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
300
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
301
        """Set the revision and tree to merge from.
302
303
        This sets the other_tree, other_rev_id, other_basis attributes.
304
305
        :param other_revision: The [path, revision] list to merge from.
306
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
307
        self.other_branch, self.other_tree = self._get_tree(other_revision,
308
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
309
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
310
            self.other_rev_id = _mod_revision.ensure_null(
311
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
312
            if _mod_revision.is_null(self.other_rev_id):
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
313
                raise NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
314
            self.other_basis = self.other_rev_id
315
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
316
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
317
            self.other_basis = self.other_rev_id
318
        else:
319
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
320
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
321
            if self.other_basis is None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
322
                raise NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
323
        if self.other_rev_id is not None:
324
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
325
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
326
2100.3.29 by Aaron Bentley
Get merge working initially
327
    def set_other_revision(self, revision_id, other_branch):
328
        """Set 'other' based on a branch and revision id
329
330
        :param revision_id: The revision to use for a tree
331
        :param other_branch: The branch containing this tree
332
        """
333
        self.other_rev_id = revision_id
334
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
335
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
336
        self.other_tree = self.revision_tree(revision_id)
337
        self.other_basis = revision_id
338
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
339
    def set_base_revision(self, revision_id, branch):
340
        """Set 'base' based on a branch and revision id
341
342
        :param revision_id: The revision to use for a tree
343
        :param branch: The branch containing this tree
344
        """
345
        self.base_rev_id = revision_id
346
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
347
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
348
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
349
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
350
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
351
        if not source.repository.has_same_location(target.repository):
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
352
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
353
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
354
    def find_base(self):
2590.2.22 by Aaron Bentley
Remove cruft
355
        revisions = [ensure_null(self.this_basis),
356
                     ensure_null(self.other_basis)]
357
        if NULL_REVISION in revisions:
358
            self.base_rev_id = NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
359
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
360
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
361
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
362
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
363
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
364
            if len(lcas) == 0:
365
                self.base_rev_id = NULL_REVISION
366
            elif len(lcas) == 1:
367
                self.base_rev_id = list(lcas)[0]
368
            else: # len(lcas) > 1
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
369
                if len(lcas) > 2:
370
                    # find_unique_lca can only handle 2 nodes, so we have to
371
                    # start back at the beginning. It is a shame to traverse
372
                    # the graph again, but better than re-implementing
373
                    # find_unique_lca.
374
                    self.base_rev_id = self.revision_graph.find_unique_lca(
375
                                            revisions[0], revisions[1])
376
                else:
377
                    self.base_rev_id = self.revision_graph.find_unique_lca(
378
                                            *lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
379
                self._is_criss_cross = True
2590.2.22 by Aaron Bentley
Remove cruft
380
            if self.base_rev_id == NULL_REVISION:
381
                raise UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
382
            if self._is_criss_cross:
1551.19.11 by Aaron Bentley
Add criss-cross help topic
383
                warning('Warning: criss-cross merge encountered.  See bzr'
384
                        ' help criss-cross.')
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
385
                interesting_revision_ids = [self.base_rev_id]
386
                interesting_revision_ids.extend(lcas)
387
                interesting_trees = dict((t.get_revision_id(), t)
388
                    for t in self.this_branch.repository.revision_trees(
389
                        interesting_revision_ids))
390
                self._cached_trees.update(interesting_trees)
391
                self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
392
                sorted_lca_keys = self.revision_graph.find_merge_order(
393
                    revisions[0], lcas)
394
                self._lca_trees = [interesting_trees[key]
395
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
396
            else:
397
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
398
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
399
        self.base_is_other_ancestor = True
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
400
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
401
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
402
        """Set the base revision to use for the merge.
403
404
        :param base_revision: A 2-list containing a path and revision number.
405
        """
1185.12.96 by Aaron Bentley
Merge from mpool
406
        mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
407
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
408
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
409
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
410
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
411
            if base_revision[1] == -1:
412
                self.base_rev_id = base_branch.last_revision()
413
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
414
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
415
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
416
                self.base_rev_id = _mod_revision.ensure_null(
417
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
418
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
419
3008.1.8 by Michael Hudson
extract merger creation into a method
420
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
421
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
422
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
423
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
424
                  'interesting_files': self.interesting_files,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
425
                  'pp': self.pp,
426
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
427
        if self.merge_type.requires_base:
428
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
429
        if self.merge_type.supports_reprocess:
430
            kwargs['reprocess'] = self.reprocess
431
        elif self.reprocess:
1551.6.14 by Aaron Bentley
Tweaks from merge review
432
            raise BzrError("Conflict reduction is not supported for merge"
433
                                  " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
434
        if self.merge_type.supports_show_base:
435
            kwargs['show_base'] = self.show_base
436
        elif self.show_base:
1534.8.2 by Aaron Bentley
Implemented weave merge
437
            raise BzrError("Showing base is not supported for this"
3008.1.14 by Michael Hudson
trivial commit for testing
438
                           " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
439
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
440
            and not self.base_is_other_ancestor):
441
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
442
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
443
            kwargs['cherrypick'] = (not self.base_is_ancestor or
444
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
445
        if self._is_criss_cross and getattr(self.merge_type,
446
                                            'supports_lca_trees', False):
447
            kwargs['lca_trees'] = self._lca_trees
3008.1.8 by Michael Hudson
extract merger creation into a method
448
        return self.merge_type(pb=self._pb,
449
                               change_reporter=self.change_reporter,
450
                               **kwargs)
451
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
452
    def _do_merge_to(self, merge):
453
        merge.do_merge()
454
        if self.recurse == 'down':
455
            for relpath, file_id in self.this_tree.iter_references():
456
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
457
                other_revision = self.other_tree.get_reference_revision(
458
                    file_id, relpath)
459
                if  other_revision == sub_tree.last_revision():
460
                    continue
461
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
462
                sub_merge.merge_type = self.merge_type
463
                other_branch = self.other_branch.reference_parent(file_id, relpath)
464
                sub_merge.set_other_revision(other_revision, other_branch)
465
                base_revision = self.base_tree.get_reference_revision(file_id)
466
                sub_merge.base_tree = \
467
                    sub_tree.branch.repository.revision_tree(base_revision)
468
                sub_merge.base_rev_id = base_revision
469
                sub_merge.do_merge()
470
        
3008.1.8 by Michael Hudson
extract merger creation into a method
471
    def do_merge(self):
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
472
        self.this_tree.lock_tree_write()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
473
        try:
474
            if self.base_tree is not None:
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
475
                self.base_tree.lock_read()
476
            try:
477
                if self.other_tree is not None:
478
                    self.other_tree.lock_read()
479
                try:
480
                    merge = self.make_merger()
481
                    self._do_merge_to(merge)
482
                finally:
483
                    if self.other_tree is not None:
484
                        self.other_tree.unlock()
485
            finally:
486
                if self.base_tree is not None:
487
                    self.base_tree.unlock()
488
        finally:
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
489
            self.this_tree.unlock()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
490
        if len(merge.cooked_conflicts) == 0:
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
491
            if not self.ignore_zero and not is_quiet():
1534.7.141 by Aaron Bentley
Added conflict reporting
492
                note("All changes applied successfully.")
493
        else:
494
            note("%d conflicts encountered." % len(merge.cooked_conflicts))
495
1534.7.134 by Aaron Bentley
Hid raw conflicts
496
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
497
1545.2.4 by Aaron Bentley
PEP8 fixes
498
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
499
class _InventoryNoneEntry(object):
500
    """This represents an inventory entry which *isn't there*.
501
502
    It simplifies the merging logic if we always have an InventoryEntry, even
503
    if it isn't actually present
504
    """
505
    executable = None
506
    kind = None
507
    name = None
508
    parent_id = None
509
    revision = None
510
    symlink_target = None
511
    text_sha1 = None
512
513
_none_entry = _InventoryNoneEntry()
514
515
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
516
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
517
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
518
    requires_base = True
519
    supports_reprocess = True
520
    supports_show_base = True
521
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
522
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
523
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
524
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
525
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
526
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
527
    def __init__(self, working_tree, this_tree, base_tree, other_tree, 
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
528
                 interesting_ids=None, reprocess=False, show_base=False,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
529
                 pb=DummyProgress(), pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
530
                 interesting_files=None, do_merge=True,
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
531
                 cherrypick=False, lca_trees=None):
2590.2.10 by Aaron Bentley
Updates from review
532
        """Initialize the merger object and perform the merge.
533
534
        :param working_tree: The working tree to apply the merge to
535
        :param this_tree: The local tree in the merge operation
536
        :param base_tree: The common tree in the merge operation
537
        :param other_tree: The other other tree to merge changes from
538
        :param interesting_ids: The file_ids of files that should be
539
            participate in the merge.  May not be combined with
540
            interesting_files.
541
        :param: reprocess If True, perform conflict-reduction processing.
542
        :param show_base: If True, show the base revision in text conflicts.
543
            (incompatible with reprocess)
544
        :param pb: A Progress bar
545
        :param pp: A ProgressPhase object
546
        :param change_reporter: An object that should report changes made
547
        :param interesting_files: The tree-relative paths of files that should
548
            participate in the merge.  If these paths refer to directories,
549
            the contents of those directories will also be included.  May not
550
            be combined with interesting_ids.  If neither interesting_files nor
551
            interesting_ids is specified, all files may participate in the
552
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
553
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
554
            if the ancestry was found to include a criss-cross merge.
555
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
556
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
557
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
558
        if interesting_files is not None and interesting_ids is not None:
559
            raise ValueError(
560
                'specify either interesting_ids or interesting_files')
2590.2.4 by Aaron Bentley
Move entry generation to a helper
561
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
562
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
563
        self.this_tree = working_tree
564
        self.base_tree = base_tree
565
        self.other_tree = other_tree
566
        self._raw_conflicts = []
567
        self.cooked_conflicts = []
568
        self.reprocess = reprocess
569
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
570
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
571
        # Uncommenting this will change the default algorithm to always use
572
        # _entries_lca. This can be useful for running the test suite and
573
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
574
        # if lca_trees is None:
575
        #     self._lca_trees = [self.base_tree]
1534.9.1 by Aaron Bentley
Added progress bars to merge
576
        self.pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
577
        self.pp = pp
1551.11.9 by Aaron Bentley
Apply change reporting to merge
578
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
579
        self.cherrypick = cherrypick
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
580
        if self.pp is None:
581
            self.pp = ProgressPhase("Merge phase", 3, self.pb)
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
582
        if do_merge:
583
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
584
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
585
    def do_merge(self):
586
        self.this_tree.lock_tree_write()
587
        self.base_tree.lock_read()
588
        self.other_tree.lock_read()
589
        self.tt = TreeTransform(self.this_tree, self.pb)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
590
        try:
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
591
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
592
            self._compute_transform()
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
593
            self.pp.next_phase()
2590.2.17 by Aaron Bentley
Avoid redundant conflict check
594
            results = self.tt.apply(no_conflicts=True)
1558.4.3 by Aaron Bentley
Merge_modified performance/concurrency fix
595
            self.write_modified(results)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
596
            try:
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
597
                self.this_tree.add_conflicts(self.cooked_conflicts)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
598
            except UnsupportedOperation:
599
                pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
600
        finally:
1711.7.7 by John Arbash Meinel
Don't squelch errors in tt.finalize()
601
            self.tt.finalize()
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
602
            self.other_tree.unlock()
603
            self.base_tree.unlock()
604
            self.this_tree.unlock()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
605
            self.pb.clear()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
606
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
607
    def make_preview_transform(self):
608
        self.base_tree.lock_read()
609
        self.other_tree.lock_read()
610
        self.tt = TransformPreview(self.this_tree)
611
        try:
612
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
613
            self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
614
            self.pp.next_phase()
615
        finally:
616
            self.other_tree.unlock()
617
            self.base_tree.unlock()
618
            self.pb.clear()
619
        return self.tt
620
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
621
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
622
        if self._lca_trees is None:
623
            entries = self._entries3()
624
            resolver = self._three_way
625
        else:
626
            entries = self._entries_lca()
627
            resolver = self._lca_multi_way
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
628
        child_pb = ui.ui_factory.nested_progress_bar()
629
        try:
630
            for num, (file_id, changed, parents3, names3,
631
                      executable3) in enumerate(entries):
632
                child_pb.update('Preparing file merge', num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
633
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
634
                if changed:
635
                    file_status = self.merge_contents(file_id)
636
                else:
637
                    file_status = 'unmodified'
638
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
639
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
640
        finally:
641
            child_pb.finished()
642
        self.fix_root()
643
        self.pp.next_phase()
644
        child_pb = ui.ui_factory.nested_progress_bar()
645
        try:
646
            fs_conflicts = resolve_conflicts(self.tt, child_pb,
647
                lambda t, c: conflict_pass(t, c, self.other_tree))
648
        finally:
649
            child_pb.finished()
650
        if self.change_reporter is not None:
651
            from bzrlib import delta
652
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
653
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
654
        self.cook_conflicts(fs_conflicts)
655
        for conflict in self.cooked_conflicts:
656
            warning(conflict)
657
2590.2.4 by Aaron Bentley
Move entry generation to a helper
658
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
659
        """Gather data about files modified between three trees.
660
661
        Return a list of tuples of file_id, changed, parents3, names3,
662
        executable3.  changed is a boolean indicating whether the file contents
663
        or kind were changed.  parents3 is a tuple of parent ids for base,
664
        other and this.  names3 is a tuple of names for base, other and this.
665
        executable3 is a tuple of execute-bit values for base, other and this.
666
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
667
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
668
        iterator = self.other_tree.iter_changes(self.base_tree,
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
669
                include_unchanged=True, specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
670
                extra_trees=[self.this_tree])
2590.2.4 by Aaron Bentley
Move entry generation to a helper
671
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
672
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
673
            if (self.interesting_ids is not None and
674
                file_id not in self.interesting_ids):
675
                continue
676
            if file_id in self.this_tree.inventory:
677
                entry = self.this_tree.inventory[file_id]
678
                this_name = entry.name
679
                this_parent = entry.parent_id
680
                this_executable = entry.executable
681
            else:
682
                this_name = None
683
                this_parent = None
684
                this_executable = None
685
            parents3 = parents + (this_parent,)
686
            names3 = names + (this_name,)
687
            executable3 = executable + (this_executable,)
688
            result.append((file_id, changed, parents3, names3, executable3))
689
        return result
690
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
691
    def _entries_lca(self):
692
        """Gather data about files modified between multiple trees.
693
694
        This compares OTHER versus all LCA trees, and for interesting entries,
695
        it then compares with THIS and BASE.
696
697
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
698
        :return: [(file_id, changed, parents, names, executable)]
699
            file_id     Simple file_id of the entry
700
            changed     Boolean, True if the kind or contents changed
701
                        else False
702
            parents     ((base, [parent_id, in, lcas]), parent_id_other,
703
                         parent_id_this)
704
            names       ((base, [name, in, lcas]), name_in_other, name_in_this)
705
            executable  ((base, [exec, in, lcas]), exec_in_other, exec_in_this)
706
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
707
        if self.interesting_files is not None:
708
            lookup_trees = [self.this_tree, self.base_tree]
709
            lookup_trees.extend(self._lca_trees)
710
            # I think we should include the lca trees as well
711
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
712
                                                        lookup_trees)
713
        else:
714
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
715
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
716
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
717
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
718
        base_inventory = self.base_tree.inventory
719
        this_inventory = self.this_tree.inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
720
        for path, file_id, other_ie, lca_values in walker.iter_all():
721
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
722
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
723
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
724
            if interesting_ids is not None and file_id not in interesting_ids:
725
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
726
3514.4.30 by John Arbash Meinel
Several updates.
727
            # If other_revision is found in any of the lcas, that means this
728
            # node is uninteresting. This is because when merging, if there are
729
            # multiple heads(), we have to create a new node. So if we didn't,
730
            # we know that the ancestry is linear, and that OTHER did not
731
            # modify anything
732
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
733
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
734
            if other_revision is not None:
735
                # We can't use this shortcut when other_revision is None,
736
                # because it may be None because things are WorkingTrees, and
737
                # not because it is *actually* None.
738
                is_unmodified = False
739
                for lca_path, ie in lca_values:
740
                    if ie is not None and ie.revision == other_revision:
741
                        is_unmodified = True
742
                        break
743
                if is_unmodified:
744
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
745
746
            lca_entries = []
747
            for lca_path, lca_ie in lca_values:
748
                if lca_ie is None:
749
                    lca_entries.append(_none_entry)
750
                else:
751
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
752
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
753
            if file_id in base_inventory:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
754
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
755
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
756
                base_ie = _none_entry
757
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
758
            if file_id in this_inventory:
759
                this_ie = this_inventory[file_id]
760
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
761
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
762
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
763
            lca_kinds = []
764
            lca_parent_ids = []
765
            lca_names = []
766
            lca_executable = []
767
            for lca_ie in lca_entries:
768
                lca_kinds.append(lca_ie.kind)
769
                lca_parent_ids.append(lca_ie.parent_id)
770
                lca_names.append(lca_ie.name)
771
                lca_executable.append(lca_ie.executable)
772
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
773
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
774
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
775
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
776
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
777
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
778
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
779
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
780
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
781
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
782
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
783
            content_changed = True
784
            if kind_winner == 'this':
785
                # No kind change in OTHER, see if there are *any* changes
786
                if other_ie.kind == None:
787
                    # No content and 'this' wins the kind, so skip this?
788
                    # continue
789
                    pass
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
790
                elif other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
791
                    if parent_id_winner == 'this' and name_winner == 'this':
792
                        # No change for this directory in OTHER, skip
793
                        continue
794
                    content_changed = False
795
                elif other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
796
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
797
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
798
                            return None
799
                        return tree.get_file_sha1(file_id)
800
                    base_sha1 = get_sha1(base_ie, self.base_tree)
801
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
802
                                 in zip(lca_entries, self._lca_trees)]
803
                    this_sha1 = get_sha1(this_ie, self.this_tree)
804
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
805
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
806
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
807
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
808
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
809
                        (base_ie.executable, lca_executable),
810
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
811
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
812
                        and sha1_winner == 'this' and exec_winner == 'this'):
813
                        # No kind, parent, name, exec, or content change for
814
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
815
                        continue
816
                    if sha1_winner == 'this':
817
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
818
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
819
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
820
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
821
                            return None
822
                        return tree.get_symlink_target(file_id)
823
                    base_target = get_target(base_ie, self.base_tree)
824
                    lca_targets = [get_target(ie, tree) for ie, tree
825
                                   in zip(lca_entries, self._lca_trees)]
826
                    this_target = get_target(this_ie, self.this_tree)
827
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
828
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
829
                        (base_target, lca_targets),
830
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
831
                    if (parent_id_winner == 'this' and name_winner == 'this'
832
                        and target_winner == 'this'):
833
                        # No kind, parent, name, or symlink target change
834
                        # not interesting
835
                        continue
836
                    if target_winner == 'this':
837
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
838
                elif other_ie.kind == 'tree-reference':
839
                    # The 'changed' information seems to be handled at a higher
840
                    # level. At least, _entries3 returns False for content
841
                    # changed, even when at a new revision_id.
842
                    content_changed = False
843
                    if (parent_id_winner == 'this' and name_winner == 'this'):
844
                        # Nothing interesting
845
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
846
                else:
847
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
848
                # XXX: We need to handle kind == 'symlink'
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
849
850
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
851
            result.append((file_id, content_changed,
852
                           ((base_ie.parent_id, lca_parent_ids),
853
                            other_ie.parent_id, this_ie.parent_id),
854
                           ((base_ie.name, lca_names),
855
                            other_ie.name, this_ie.name),
856
                           ((base_ie.executable, lca_executable),
857
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
858
                          ))
859
        return result
860
861
1731.1.33 by Aaron Bentley
Revert no-special-root changes
862
    def fix_root(self):
863
        try:
864
            self.tt.final_kind(self.tt.root)
865
        except NoSuchFile:
866
            self.tt.cancel_deletion(self.tt.root)
867
        if self.tt.final_file_id(self.tt.root) is None:
868
            self.tt.version_file(self.tt.tree_file_id(self.tt.root), 
869
                                 self.tt.root)
870
        if self.other_tree.inventory.root is None:
871
            return
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
872
        other_root_file_id = self.other_tree.get_root_id()
1731.1.33 by Aaron Bentley
Revert no-special-root changes
873
        other_root = self.tt.trans_id_file_id(other_root_file_id)
874
        if other_root == self.tt.root:
875
            return
876
        try:
877
            self.tt.final_kind(other_root)
878
        except NoSuchFile:
879
            return
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
880
        if self.other_tree.inventory.root.file_id in self.this_tree.inventory:
881
            # the other tree's root is a non-root in the current tree
882
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
883
        self.reparent_children(self.other_tree.inventory.root, self.tt.root)
884
        self.tt.cancel_creation(other_root)
885
        self.tt.cancel_versioning(other_root)
886
887
    def reparent_children(self, ie, target):
888
        for thing, child in ie.children.iteritems():
889
            trans_id = self.tt.trans_id_file_id(child.file_id)
890
            self.tt.adjust_path(self.tt.final_name(trans_id), target, trans_id)
891
1534.7.192 by Aaron Bentley
Record hashes produced by merges
892
    def write_modified(self, results):
893
        modified_hashes = {}
894
        for path in results.modified_paths:
895
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
896
            if file_id is None:
897
                continue
898
            hash = self.this_tree.get_file_sha1(file_id)
899
            if hash is None:
900
                continue
901
            modified_hashes[file_id] = hash
902
        self.this_tree.set_merge_modified(modified_hashes)
903
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
904
    @staticmethod
905
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
906
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
907
        if entry is None:
908
            return None
909
        return entry.parent_id
910
911
    @staticmethod
912
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
913
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
914
        if entry is None:
915
            return None
916
        return entry.name
917
    
918
    @staticmethod
919
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
920
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
921
        if file_id not in tree:
922
            return None
923
        return tree.get_file_sha1(file_id)
924
925
    @staticmethod
926
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
927
        """Determine the executability of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
928
        if file_id not in tree:
929
            return None
930
        if tree.kind(file_id) != "file":
931
            return False
932
        return tree.is_executable(file_id)
933
934
    @staticmethod
935
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
936
        """Determine the kind of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
937
        if file_id not in tree:
938
            return None
939
        return tree.kind(file_id)
940
941
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
942
    def _three_way(base, other, this):
943
        #if base == other, either they all agree, or only THIS has changed.
944
        if base == other:
945
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
946
        elif this not in (base, other):
2590.2.8 by Aaron Bentley
Restore conflict handling changes
947
            return 'conflict'
2590.2.10 by Aaron Bentley
Updates from review
948
        # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
949
        elif this == other:
950
            return "this"
2590.2.10 by Aaron Bentley
Updates from review
951
        # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
952
        else:
953
            return "other"
954
955
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
956
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
957
        """Consider LCAs when determining whether a change has occurred.
958
959
        If LCAS are all identical, this is the same as a _three_way comparison.
960
961
        :param bases: value in (BASE, [LCAS])
962
        :param other: value in OTHER
963
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
964
        :param allow_overriding_lca: If there is more than one unique lca
965
            value, allow OTHER to override THIS if it has a new value, and
966
            THIS only has an lca value, or vice versa. This is appropriate for
967
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
968
        :return: 'this', 'other', or 'conflict' depending on whether an entry
969
            changed or not.
970
        """
3514.4.30 by John Arbash Meinel
Several updates.
971
        # See doc/developers/lca_merge_resolution.txt for details about this
972
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
973
        if other == this:
974
            # Either Ambiguously clean, or nothing was actually changed. We
975
            # don't really care
976
            return 'this'
977
        base_val, lca_vals = bases
978
        # Remove 'base_val' from the lca_vals, because it is not interesting
979
        filtered_lca_vals = [lca_val for lca_val in lca_vals
980
                                      if lca_val != base_val]
981
        if len(filtered_lca_vals) == 0:
982
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
983
984
        unique_lca_vals = set(filtered_lca_vals)
985
        if len(unique_lca_vals) == 1:
986
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
987
988
        if allow_overriding_lca:
989
            if other in unique_lca_vals:
990
                if this in unique_lca_vals:
991
                    # Each side picked a different lca, conflict
992
                    return 'conflict'
993
                else:
994
                    # This has a value which supersedes both lca values, and
995
                    # other only has an lca value
996
                    return 'this'
997
            elif this in unique_lca_vals:
998
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
999
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1000
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1001
1002
        # At this point, the lcas disagree, and the tips disagree
1003
        return 'conflict'
1004
1005
    @staticmethod
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1006
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
1007
        """Do a three-way test on a scalar.
1008
        Return "this", "other" or "conflict", depending whether a value wins.
1009
        """
1010
        key_base = key(base_tree, file_id)
1011
        key_other = key(other_tree, file_id)
1012
        #if base == other, either they all agree, or only THIS has changed.
1013
        if key_base == key_other:
1014
            return "this"
1015
        key_this = key(this_tree, file_id)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1016
        # "Ambiguous clean merge"
1017
        if key_this == key_other:
1018
            return "this"
1019
        elif key_this == key_base:
1020
            return "other"
1021
        else:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1022
            return "conflict"
1023
1024
    def merge_names(self, file_id):
1025
        def get_entry(tree):
1026
            if file_id in tree.inventory:
1027
                return tree.inventory[file_id]
1028
            else:
1029
                return None
1030
        this_entry = get_entry(self.this_tree)
1031
        other_entry = get_entry(self.other_tree)
1032
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1033
        entries = (base_entry, other_entry, this_entry)
1034
        names = []
1035
        parents = []
1036
        for entry in entries:
1037
            if entry is None:
1038
                names.append(None)
1039
                parents.append(None)
1040
            else:
1041
                names.append(entry.name)
1042
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1043
        return self._merge_names(file_id, parents, names,
1044
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1045
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1046
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1047
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1048
        base_name, other_name, this_name = names
1049
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1050
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1051
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1052
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1053
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1054
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1055
            if name_winner == "this":
1056
                name_winner = "other"
1057
            if parent_id_winner == "this":
1058
                parent_id_winner = "other"
1059
        if name_winner == "this" and parent_id_winner == "this":
1060
            return
1061
        if name_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1062
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1063
            self._raw_conflicts.append(('name conflict', trans_id, 
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1064
                                        this_name, other_name))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1065
        if parent_id_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1066
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1067
            self._raw_conflicts.append(('parent conflict', trans_id, 
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1068
                                        this_parent, other_parent))
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1069
        if other_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1070
            # it doesn't matter whether the result was 'other' or 
1071
            # 'conflict'-- if there's no 'other', we leave it alone.
1072
            return
1073
        # if we get here, name_winner and parent_winner are set to safe values.
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1074
        trans_id = self.tt.trans_id_file_id(file_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1075
        parent_id = parents[self.winner_idx[parent_id_winner]]
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1076
        if parent_id is not None:
1077
            parent_trans_id = self.tt.trans_id_file_id(parent_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1078
            self.tt.adjust_path(names[self.winner_idx[name_winner]],
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1079
                                parent_trans_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1080
1081
    def merge_contents(self, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1082
        """Performa a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1083
        def contents_pair(tree):
1084
            if file_id not in tree:
1085
                return (None, None)
1086
            kind = tree.kind(file_id)
1087
            if kind == "file":
1088
                contents = tree.get_file_sha1(file_id)
1089
            elif kind == "symlink":
1090
                contents = tree.get_symlink_target(file_id)
1091
            else:
1092
                contents = None
1093
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1094
1095
        def contents_conflict():
1096
            trans_id = self.tt.trans_id_file_id(file_id)
1097
            name = self.tt.final_name(trans_id)
1098
            parent_id = self.tt.final_parent(trans_id)
1099
            if file_id in self.this_tree.inventory:
1100
                self.tt.unversion_file(trans_id)
1551.10.2 by Aaron Bentley
Handle merge with dangling inventory entries
1101
                if file_id in self.this_tree:
1102
                    self.tt.delete_contents(trans_id)
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1103
            file_group = self._dump_conflicts(name, parent_id, file_id, 
1104
                                              set_version=True)
1105
            self._raw_conflicts.append(('contents conflict', file_group))
1106
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1107
        # See SPOT run.  run, SPOT, run.
1108
        # So we're not QUITE repeating ourselves; we do tricky things with
1109
        # file kind...
1110
        base_pair = contents_pair(self.base_tree)
1111
        other_pair = contents_pair(self.other_tree)
1112
        if base_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1113
            # OTHER introduced no changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1114
            return "unmodified"
1115
        this_pair = contents_pair(self.this_tree)
1116
        if this_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1117
            # THIS and OTHER introduced the same changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1118
            return "unmodified"
1119
        else:
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1120
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1121
            if this_pair == base_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1122
                # only OTHER introduced changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1123
                if file_id in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1124
                    # Remove any existing contents
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1125
                    self.tt.delete_contents(trans_id)
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
1126
                if file_id in self.other_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1127
                    # OTHER changed the file
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1128
                    create_by_entry(self.tt, 
1129
                                    self.other_tree.inventory[file_id], 
1130
                                    self.other_tree, trans_id)
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
1131
                    if file_id not in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1132
                        self.tt.version_file(file_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1133
                    return "modified"
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
1134
                elif file_id in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1135
                    # OTHER deleted the file
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1136
                    self.tt.unversion_file(trans_id)
1137
                    return "deleted"
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1138
            #BOTH THIS and OTHER introduced changes; scalar conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1139
            elif this_pair[0] == "file" and other_pair[0] == "file":
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1140
                # THIS and OTHER are both files, so text merge.  Either
1141
                # BASE is a file, or both converted to files, so at least we
1142
                # have agreement that output should be a file.
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1143
                try:
1144
                    self.text_merge(file_id, trans_id)
1145
                except BinaryFile:
1146
                    return contents_conflict()
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
1147
                if file_id not in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1148
                    self.tt.version_file(file_id, trans_id)
1534.7.152 by Aaron Bentley
Fixed overwrites
1149
                try:
1150
                    self.tt.tree_kind(trans_id)
1151
                    self.tt.delete_contents(trans_id)
1152
                except NoSuchFile:
1153
                    pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1154
                return "modified"
1155
            else:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1156
                # Scalar conflict, can't text merge.  Dump conflicts
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1157
                return contents_conflict()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1158
1159
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1160
        """Return the lines in a file, or an empty list."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1161
        if file_id in tree:
1162
            return tree.get_file(file_id).readlines()
1163
        else:
1164
            return []
1165
1166
    def text_merge(self, file_id, trans_id):
1167
        """Perform a three-way text merge on a file_id"""
1168
        # it's possible that we got here with base as a different type.
1169
        # if so, we just want two-way text conflicts.
1170
        if file_id in self.base_tree and \
1171
            self.base_tree.kind(file_id) == "file":
1172
            base_lines = self.get_lines(self.base_tree, file_id)
1173
        else:
1174
            base_lines = []
1175
        other_lines = self.get_lines(self.other_tree, file_id)
1176
        this_lines = self.get_lines(self.this_tree, file_id)
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1177
        m3 = Merge3(base_lines, this_lines, other_lines,
1178
                    is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1179
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1180
        if self.show_base is True:
1181
            base_marker = '|' * 7
1182
        else:
1183
            base_marker = None
1184
1185
        def iter_merge3(retval):
1186
            retval["text_conflicts"] = False
1187
            for line in m3.merge_lines(name_a = "TREE", 
1188
                                       name_b = "MERGE-SOURCE", 
1189
                                       name_base = "BASE-REVISION",
1190
                                       start_marker=start_marker, 
1191
                                       base_marker=base_marker,
1192
                                       reprocess=self.reprocess):
1193
                if line.startswith(start_marker):
1194
                    retval["text_conflicts"] = True
1195
                    yield line.replace(start_marker, '<' * 7)
1196
                else:
1197
                    yield line
1198
        retval = {}
1199
        merge3_iterator = iter_merge3(retval)
1200
        self.tt.create_file(merge3_iterator, trans_id)
1201
        if retval["text_conflicts"] is True:
1202
            self._raw_conflicts.append(('text conflict', trans_id))
1203
            name = self.tt.final_name(trans_id)
1204
            parent_id = self.tt.final_parent(trans_id)
1205
            file_group = self._dump_conflicts(name, parent_id, file_id, 
1206
                                              this_lines, base_lines,
1207
                                              other_lines)
1208
            file_group.append(trans_id)
1209
1210
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None, 
1211
                        base_lines=None, other_lines=None, set_version=False,
1212
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1213
        """Emit conflict files.
1214
        If this_lines, base_lines, or other_lines are omitted, they will be
1215
        determined automatically.  If set_version is true, the .OTHER, .THIS
1216
        or .BASE (in that order) will be created as versioned files.
1217
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1218
        data = [('OTHER', self.other_tree, other_lines), 
1219
                ('THIS', self.this_tree, this_lines)]
1220
        if not no_base:
1221
            data.append(('BASE', self.base_tree, base_lines))
1222
        versioned = False
1223
        file_group = []
1224
        for suffix, tree, lines in data:
1225
            if file_id in tree:
1226
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
1227
                                               suffix, lines)
1228
                file_group.append(trans_id)
1229
                if set_version and not versioned:
1230
                    self.tt.version_file(file_id, trans_id)
1231
                    versioned = True
1232
        return file_group
1233
           
1234
    def _conflict_file(self, name, parent_id, tree, file_id, suffix, 
1235
                       lines=None):
1534.7.157 by Aaron Bentley
Added more docs
1236
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1237
        name = name + '.' + suffix
1238
        trans_id = self.tt.create_path(name, parent_id)
1239
        entry = tree.inventory[file_id]
1240
        create_by_entry(self.tt, entry, tree, trans_id, lines)
1241
        return trans_id
1242
1243
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1244
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1245
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1246
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1247
        self._merge_executable(file_id, executable, file_status,
1248
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1249
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1250
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1251
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1252
        """Perform a merge on the execute bit."""
1253
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1254
        if file_status == "deleted":
1255
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1256
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1257
        if winner == "conflict":
1258
        # There must be a None in here, if we have a conflict, but we
1259
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1260
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1261
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1262
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1263
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1264
        if winner == 'this' and file_status != "modified":
1265
            return
1266
        trans_id = self.tt.trans_id_file_id(file_id)
1267
        try:
1268
            if self.tt.final_kind(trans_id) != "file":
1269
                return
1270
        except NoSuchFile:
1271
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1272
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1273
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1274
        else:
1275
            if file_id in self.other_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1276
                executability = other_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1277
            elif file_id in self.this_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1278
                executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1279
            elif file_id in self.base_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1280
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1281
        if executability is not None:
1282
            trans_id = self.tt.trans_id_file_id(file_id)
1283
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1284
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1285
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1286
        """Convert all conflicts into a form that doesn't depend on trans_id"""
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1287
        from conflicts import Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1288
        name_conflicts = {}
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1289
        self.cooked_conflicts.extend(cook_conflicts(fs_conflicts, self.tt))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1290
        fp = FinalPaths(self.tt)
1291
        for conflict in self._raw_conflicts:
1292
            conflict_type = conflict[0]
1293
            if conflict_type in ('name conflict', 'parent conflict'):
1294
                trans_id = conflict[1]
1295
                conflict_args = conflict[2:]
1296
                if trans_id not in name_conflicts:
1297
                    name_conflicts[trans_id] = {}
1298
                unique_add(name_conflicts[trans_id], conflict_type, 
1299
                           conflict_args)
1300
            if conflict_type == 'contents conflict':
1301
                for trans_id in conflict[1]:
1302
                    file_id = self.tt.final_file_id(trans_id)
1303
                    if file_id is not None:
1304
                        break
1305
                path = fp.get_path(trans_id)
1306
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1307
                    if path.endswith(suffix):
1308
                        path = path[:-len(suffix)]
1309
                        break
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1310
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1311
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1312
            if conflict_type == 'text conflict':
1313
                trans_id = conflict[1]
1314
                path = fp.get_path(trans_id)
1315
                file_id = self.tt.final_file_id(trans_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1316
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1317
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1318
1319
        for trans_id, conflicts in name_conflicts.iteritems():
1320
            try:
1321
                this_parent, other_parent = conflicts['parent conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1322
                if this_parent == other_parent:
1323
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1324
            except KeyError:
1325
                this_parent = other_parent = \
1326
                    self.tt.final_file_id(self.tt.final_parent(trans_id))
1327
            try:
1328
                this_name, other_name = conflicts['name conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1329
                if this_name == other_name:
1330
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1331
            except KeyError:
1332
                this_name = other_name = self.tt.final_name(trans_id)
1333
            other_path = fp.get_path(trans_id)
1551.16.2 by Aaron Bentley
Don't crash on merging renamed deleted files (#110279)
1334
            if this_parent is not None and this_name is not None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1335
                this_parent_path = \
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1336
                    fp.get_path(self.tt.trans_id_file_id(this_parent))
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1337
                this_path = pathjoin(this_parent_path, this_name)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1338
            else:
1339
                this_path = "<deleted>"
1340
            file_id = self.tt.final_file_id(trans_id)
1534.10.20 by Aaron Bentley
Got all tests passing
1341
            c = Conflict.factory('path conflict', path=this_path,
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1342
                                 conflict_path=other_path, file_id=file_id)
1343
            self.cooked_conflicts.append(c)
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
1344
        self.cooked_conflicts.sort(key=Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1345
1346
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1347
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1348
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1349
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1350
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1351
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1352
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1353
1354
    def _merged_lines(self, file_id):
1355
        """Generate the merged lines.
1356
        There is no distinction between lines that are meant to contain <<<<<<<
1357
        and conflicts.
1358
        """
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1359
        if self.cherrypick:
1360
            base = self.base_tree
1361
        else:
1362
            base = None
3062.2.4 by Aaron Bentley
Start supporting merge-with-base
1363
        plan = self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1364
                                              base=base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1365
        if 'merge' in debug.debug_flags:
1366
            plan = list(plan)
1367
            trans_id = self.tt.trans_id_file_id(file_id)
1368
            name = self.tt.final_name(trans_id) + '.plan'
1369
            contents = ('%10s|%s' % l for l in plan)
1370
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1551.15.52 by Aaron Bentley
Tweak from review comments
1371
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1372
            '>>>>>>> MERGE-SOURCE\n')
1373
        return textmerge.merge_lines(self.reprocess)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1374
1375
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1376
        """Perform a (weave) text merge for a given file and file-id.
1377
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1378
        and a conflict will be noted.
1379
        """
1551.6.12 by Aaron Bentley
Indicate conflicts from merge_lines, insead of guessing
1380
        lines, conflicts = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1381
        lines = list(lines)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1382
        # Note we're checking whether the OUTPUT is binary in this case, 
1383
        # because we don't want to get into weave merge guts.
1384
        check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1385
        self.tt.create_file(lines, trans_id)
1386
        if conflicts:
1387
            self._raw_conflicts.append(('text conflict', trans_id))
1388
            name = self.tt.final_name(trans_id)
1389
            parent_id = self.tt.final_parent(trans_id)
1390
            file_group = self._dump_conflicts(name, parent_id, file_id, 
1391
                                              no_base=True)
1392
            file_group.append(trans_id)
1393
1394
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1395
class LCAMerger(WeaveMerger):
1396
1397
    def _merged_lines(self, file_id):
1398
        """Generate the merged lines.
1399
        There is no distinction between lines that are meant to contain <<<<<<<
1400
        and conflicts.
1401
        """
1402
        if self.cherrypick:
1403
            base = self.base_tree
1404
        else:
1405
            base = None
1406
        plan = self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
1407
                                                  base=base)
1408
        if 'merge' in debug.debug_flags:
1409
            plan = list(plan)
1410
            trans_id = self.tt.trans_id_file_id(file_id)
1411
            name = self.tt.final_name(trans_id) + '.plan'
1412
            contents = ('%10s|%s' % l for l in plan)
1413
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1414
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1415
            '>>>>>>> MERGE-SOURCE\n')
1416
        return textmerge.merge_lines(self.reprocess)
1417
1418
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1419
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1420
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1421
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1422
    def dump_file(self, temp_dir, name, tree, file_id):
1423
        out_path = pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1424
        out_file = open(out_path, "wb")
1425
        try:
1426
            in_file = tree.get_file(file_id)
1427
            for line in in_file:
1428
                out_file.write(line)
1429
        finally:
1430
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1431
        return out_path
1432
1433
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1434
        """Perform a diff3 merge using a specified file-id and trans-id.
1435
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1436
        will be dumped, and a will be conflict noted.
1437
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1438
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1439
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1440
        try:
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1441
            new_file = pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1442
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1443
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1444
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1445
            status = bzrlib.patch.diff3(new_file, this, base, other)
1446
            if status not in (0, 1):
1447
                raise BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1448
            f = open(new_file, 'rb')
1449
            try:
1450
                self.tt.create_file(f, trans_id)
1451
            finally:
1452
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1453
            if status == 1:
1454
                name = self.tt.final_name(trans_id)
1455
                parent_id = self.tt.final_parent(trans_id)
1456
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1457
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1458
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1459
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1460
1461
1462
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1463
                backup_files=False,
1464
                merge_type=Merge3Merger,
1465
                interesting_ids=None,
1466
                show_base=False,
1467
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1468
                other_rev_id=None,
1469
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1470
                this_tree=None,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1471
                pb=DummyProgress(),
1472
                change_reporter=None):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1473
    """Primary interface for merging. 
1474
1475
        typical use is probably 
1476
        'merge_inner(branch, branch.get_revision_tree(other_revision),
1477
                     branch.get_revision_tree(base_revision))'
1478
        """
1479
    if this_tree is None:
2367.2.1 by Robert Collins
Remove bzrlib 0.8 compatability where it was making the code unclear or messy. (Robert Collins)
1480
        raise BzrError("bzrlib.merge.merge_inner requires a this_tree "
1481
            "parameter as of bzrlib version 0.8.")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1482
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1483
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1484
    merger.backup_files = backup_files
1485
    merger.merge_type = merge_type
1486
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1487
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1488
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1489
        if interesting_ids:
1490
            raise ValueError('Only supply interesting_ids'
1491
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1492
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1493
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1494
    merger.reprocess = reprocess
1495
    merger.other_rev_id = other_rev_id
1496
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1497
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1498
    if get_revision_id is None:
1499
        get_revision_id = base_tree.last_revision
1500
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1501
    return merger.do_merge()
1502
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1503
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1504
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1505
1506
    This method provides a sanctioned way to retrieve it.
1507
    """
1508
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1509
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1510
1511
1512
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1513
    def status_a(revision, text):
1514
        if revision in ancestors_b:
1515
            return 'killed-b', text
1516
        else:
1517
            return 'new-a', text
1518
1519
    def status_b(revision, text):
1520
        if revision in ancestors_a:
1521
            return 'killed-a', text
1522
        else:
1523
            return 'new-b', text
1524
1525
    plain_a = [t for (a, t) in annotated_a]
1526
    plain_b = [t for (a, t) in annotated_b]
1527
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1528
    blocks = matcher.get_matching_blocks()
1529
    a_cur = 0
1530
    b_cur = 0
1531
    for ai, bi, l in blocks:
1532
        # process all mismatched sections
1533
        # (last mismatched section is handled because blocks always
1534
        # includes a 0-length last block)
1535
        for revision, text in annotated_a[a_cur:ai]:
1536
            yield status_a(revision, text)
1537
        for revision, text in annotated_b[b_cur:bi]:
1538
            yield status_b(revision, text)
1539
        # and now the matched section
1540
        a_cur = ai + l
1541
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
1542
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
1543
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1544
1545
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1546
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1547
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1548
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1549
        """Contructor.
1550
1551
        :param a_rev: Revision-id of one revision to merge
1552
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1553
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1554
        :param key_prefix: A prefix for accessing keys in vf, typically
1555
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1556
        """
1557
        self.a_rev = a_rev
1558
        self.b_rev = b_rev
1559
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
1560
        self._last_lines = None
1561
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
1562
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1563
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1564
        self._precache_tip_lines()
1565
1566
    def _precache_tip_lines(self):
1567
        lines = self.get_lines([self.a_rev, self.b_rev])
1568
        self.lines_a = lines[self.a_rev]
1569
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1570
1571
    def get_lines(self, revisions):
1572
        """Get lines for revisions from the backing VersionedFiles.
1573
        
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1574
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1575
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1576
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1577
        result = {}
1578
        for record in self.vf.get_record_stream(keys, 'unordered', True):
1579
            if record.storage_kind == 'absent':
1580
                raise errors.RevisionNotPresent(record.key, self.vf)
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1581
            result[record.key[-1]] = osutils.split_lines(
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1582
                record.get_bytes_as('fulltext'))
1583
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1584
1585
    def plan_merge(self):
1586
        """Generate a 'plan' for merging the two revisions.
1587
1588
        This involves comparing their texts and determining the cause of
1589
        differences.  If text A has a line and text B does not, then either the
1590
        line was added to text A, or it was deleted from B.  Once the causes
1591
        are combined, they are written out in the format described in
1592
        VersionedFile.plan_merge
1593
        """
1594
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1595
        unique_a, unique_b = self._unique_lines(blocks)
1596
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
1597
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
1598
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
1599
1600
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1601
        last_i = 0
1602
        last_j = 0
1603
        for i, j, n in blocks:
1604
            for a_index in range(last_i, i):
1605
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
1606
                    if a_index in killed_b:
1607
                        yield 'conflicted-a', self.lines_a[a_index]
1608
                    else:
1609
                        yield 'new-a', self.lines_a[a_index]
1610
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1611
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1612
            for b_index in range(last_j, j):
1613
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
1614
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
1615
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
1616
                    else:
1617
                        yield 'new-b', self.lines_b[b_index]
1618
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1619
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1620
            # handle common lines
1621
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1622
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1623
            last_i = i+n
1624
            last_j = j+n
1625
1626
    def _get_matching_blocks(self, left_revision, right_revision):
1627
        """Return a description of which sections of two revisions match.
1628
1629
        See SequenceMatcher.get_matching_blocks
1630
        """
3144.3.7 by Aaron Bentley
Update from review
1631
        cached = self._cached_matching_blocks.get((left_revision,
1632
                                                   right_revision))
1633
        if cached is not None:
1634
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
1635
        if self._last_lines_revision_id == left_revision:
1636
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1637
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1638
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1639
            lines = self.get_lines([left_revision, right_revision])
1640
            left_lines = lines[left_revision]
1641
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1642
        self._last_lines = right_lines
1643
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1644
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
1645
                                                       right_lines)
1646
        return matcher.get_matching_blocks()
1647
1648
    def _unique_lines(self, matching_blocks):
1649
        """Analyse matching_blocks to determine which lines are unique
1650
1651
        :return: a tuple of (unique_left, unique_right), where the values are
1652
            sets of line numbers of unique lines.
1653
        """
1654
        last_i = 0
1655
        last_j = 0
1656
        unique_left = []
1657
        unique_right = []
1658
        for i, j, n in matching_blocks:
1659
            unique_left.extend(range(last_i, i))
1660
            unique_right.extend(range(last_j, j))
1661
            last_i = i + n
1662
            last_j = j + n
1663
        return unique_left, unique_right
1664
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1665
    @staticmethod
1666
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
1667
        """Remove changes from new_plan that came from old_plan.
1668
1669
        It is assumed that the difference between the old_plan and new_plan
1670
        is their choice of 'b' text.
1671
1672
        All lines from new_plan that differ from old_plan are emitted
1673
        verbatim.  All lines from new_plan that match old_plan but are
1674
        not about the 'b' revision are emitted verbatim.
1675
1676
        Lines that match and are about the 'b' revision are the lines we
1677
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
1678
        is skipped entirely.
1679
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1680
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
1681
                                                       new_plan)
1682
        last_j = 0
1683
        for i, j, n in matcher.get_matching_blocks():
1684
            for jj in range(last_j, j):
1685
                yield new_plan[jj]
1686
            for jj in range(j, j+n):
1687
                plan_line = new_plan[jj]
1688
                if plan_line[0] == 'new-b':
1689
                    pass
1690
                elif plan_line[0] == 'killed-b':
1691
                    yield 'unchanged', plan_line[1]
1692
                else:
1693
                    yield plan_line
1694
            last_j = j + n
1695
1696
1697
class _PlanMerge(_PlanMergeBase):
1698
    """Plan an annotate merge using on-the-fly annotation"""
1699
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1700
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1701
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
1702
        self.a_key = self._key_prefix + (self.a_rev,)
1703
        self.b_key = self._key_prefix + (self.b_rev,)
1704
        self.graph = Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
1705
        heads = self.graph.heads((self.a_key, self.b_key))
1706
        if len(heads) == 1:
1707
            # one side dominates, so we can just return its values, yay for
1708
            # per-file graphs
1709
            # Ideally we would know that before we get this far
1710
            self._head_key = heads.pop()
1711
            if self._head_key == self.a_key:
1712
                other = b_rev
1713
            else:
1714
                other = a_rev
1715
            mutter('found dominating revision for %s\n%s > %s', self.vf,
1716
                   self._head_key[-1], other)
1717
            self._weave = None
1718
        else:
1719
            self._head_key = None
1720
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1721
1722
    def _precache_tip_lines(self):
1723
        # Turn this into a no-op, because we will do this later
1724
        pass
1725
1726
    def _find_recursive_lcas(self):
1727
        """Find all the ancestors back to a unique lca"""
1728
        cur_ancestors = (self.a_key, self.b_key)
1729
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1730
        # rather than a key tuple. We will just map that directly to no common
1731
        # ancestors.
1732
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1733
        while True:
1734
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1735
            # Map a plain NULL_REVISION to a simple no-ancestors
1736
            if next_lcas == set([NULL_REVISION]):
1737
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1738
            # Order the lca's based on when they were merged into the tip
1739
            # While the actual merge portion of weave merge uses a set() of
1740
            # active revisions, the order of insertion *does* effect the
1741
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1742
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1743
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
1744
                                                                    next_lcas))
1745
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1746
            if len(next_lcas) == 0:
1747
                break
1748
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1749
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1750
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
1751
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1752
                # More than 2 lca's, fall back to grabbing all nodes between
1753
                # this and the unique lca.
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
1754
                mutter('More than 2 LCAs, falling back to all nodes for:'
1755
                       ' %s, %s\n=> %s', self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1756
                cur_lcas = next_lcas
1757
                while len(cur_lcas) > 1:
1758
                    cur_lcas = self.graph.find_lca(*cur_lcas)
1759
                if len(cur_lcas) == 0:
1760
                    # No common base to find, use the full ancestry
1761
                    unique_lca = None
1762
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1763
                    unique_lca = list(cur_lcas)[0]
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1764
                    if unique_lca == NULL_REVISION:
1765
                        # find_lca will return a plain 'NULL_REVISION' rather
1766
                        # than a key tuple when there is no common ancestor, we
1767
                        # prefer to just use None, because it doesn't confuse
1768
                        # _get_interesting_texts()
1769
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1770
                parent_map.update(self._find_unique_parents(next_lcas,
1771
                                                            unique_lca))
1772
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1773
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1774
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1775
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1776
    def _find_unique_parents(self, tip_keys, base_key):
1777
        """Find ancestors of tip that aren't ancestors of base.
1778
        
1779
        :param tip_keys: Nodes that are interesting
1780
        :param base_key: Cull all ancestors of this node
1781
        :return: The parent map for all revisions between tip_keys and
1782
            base_key. base_key will be included. References to nodes outside of
1783
            the ancestor set will also be removed.
1784
        """
1785
        # TODO: this would be simpler if find_unique_ancestors took a list
1786
        #       instead of a single tip, internally it supports it, but it
1787
        #       isn't a "backwards compatible" api change.
1788
        if base_key is None:
1789
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1790
            # We remove NULL_REVISION because it isn't a proper tuple key, and
1791
            # thus confuses things like _get_interesting_texts, and our logic
1792
            # to add the texts into the memory weave.
1793
            if NULL_REVISION in parent_map:
1794
                parent_map.pop(NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1795
        else:
1796
            interesting = set()
1797
            for tip in tip_keys:
1798
                interesting.update(
1799
                    self.graph.find_unique_ancestors(tip, [base_key]))
1800
            parent_map = self.graph.get_parent_map(interesting)
1801
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1802
        culled_parent_map, child_map, tails = self._remove_external_references(
1803
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1804
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1805
        if base_key is not None:
1806
            tails.remove(base_key)
1807
            self._prune_tails(culled_parent_map, child_map, tails)
1808
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
1809
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
1810
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1811
1812
    @staticmethod
1813
    def _remove_external_references(parent_map):
1814
        """Remove references that go outside of the parent map.
1815
1816
        :param parent_map: Something returned from Graph.get_parent_map(keys)
1817
        :return: (filtered_parent_map, child_map, tails)
1818
            filtered_parent_map is parent_map without external references
1819
            child_map is the {parent_key: [child_keys]} mapping
1820
            tails is a list of nodes that do not have any parents in the map
1821
        """
1822
        # TODO: The basic effect of this function seems more generic than
1823
        #       _PlanMerge. But the specific details of building a child_map,
1824
        #       and computing tails seems very specific to _PlanMerge.
1825
        #       Still, should this be in Graph land?
1826
        filtered_parent_map = {}
1827
        child_map = {}
1828
        tails = []
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1829
        for key, parent_keys in parent_map.iteritems():
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1830
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
1831
            if not culled_parent_keys:
1832
                tails.append(key)
1833
            for parent_key in culled_parent_keys:
1834
                child_map.setdefault(parent_key, []).append(key)
1835
            # TODO: Do we want to do this, it adds overhead for every node,
1836
            #       just to say that the node has no children
1837
            child_map.setdefault(key, [])
1838
            filtered_parent_map[key] = culled_parent_keys
1839
        return filtered_parent_map, child_map, tails
1840
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1841
    @staticmethod
1842
    def _prune_tails(parent_map, child_map, tails_to_remove):
1843
        """Remove tails from the parent map.
1844
        
1845
        This will remove the supplied revisions until no more children have 0
1846
        parents.
1847
1848
        :param parent_map: A dict of {child: [parents]}, this dictionary will
1849
            be modified in place.
1850
        :param tails_to_remove: A list of tips that should be removed,
1851
            this list will be consumed
1852
        :param child_map: The reverse dict of parent_map ({parent: [children]})
1853
            this dict will be modified
1854
        :return: None, parent_map will be modified in place.
1855
        """
1856
        while tails_to_remove:
1857
            next = tails_to_remove.pop()
1858
            parent_map.pop(next)
1859
            children = child_map.pop(next)
1860
            for child in children:
1861
                child_parents = parent_map[child]
1862
                child_parents.remove(next)
1863
                if len(child_parents) == 0:
1864
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1865
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1866
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1867
        """Return a dict of texts we are interested in.
1868
1869
        Note that the input is in key tuples, but the output is in plain
1870
        revision ids.
1871
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1872
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1873
        :return: A dict of {'revision_id':lines} as returned by
1874
            _PlanMergeBase.get_lines()
1875
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1876
        all_revision_keys = set(parent_map)
1877
        all_revision_keys.add(self.a_key)
1878
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1879
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1880
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
1881
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1882
        return all_texts
1883
1884
    def _build_weave(self):
1885
        from bzrlib import weave
1886
        self._weave = weave.Weave(weave_name='in_memory_weave',
1887
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1888
        parent_map = self._find_recursive_lcas()
1889
1890
        all_texts = self._get_interesting_texts(parent_map)
1891
1892
        # Note: Unfortunately, the order given by topo_sort will effect the
1893
        # ordering resolution in the output. Specifically, if you add A then B,
1894
        # then in the output text A lines will show up before B lines. And, of
1895
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1896
        # So we use merge_sort, and add a fake node on the tip.
1897
        # This ensures that left-hand parents will always be inserted into the
1898
        # weave before right-hand parents.
1899
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
1900
        parent_map[tip_key] = (self.a_key, self.b_key)
1901
1902
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
1903
                                                                  tip_key)):
1904
            if key == tip_key:
1905
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1906
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1907
            parent_keys = parent_map[key]
1908
            revision_id = key[-1]
1909
            parent_ids = [k[-1] for k in parent_keys]
1910
            self._weave.add_lines(revision_id, parent_ids,
1911
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1912
1913
    def plan_merge(self):
1914
        """Generate a 'plan' for merging the two revisions.
1915
1916
        This involves comparing their texts and determining the cause of
1917
        differences.  If text A has a line and text B does not, then either the
1918
        line was added to text A, or it was deleted from B.  Once the causes
1919
        are combined, they are written out in the format described in
1920
        VersionedFile.plan_merge
1921
        """
1922
        if self._head_key is not None: # There was a single head
1923
            if self._head_key == self.a_key:
1924
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1925
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1926
                if self._head_key != self.b_key:
1927
                    raise AssertionError('There was an invalid head: %s != %s'
1928
                                         % (self.b_key, self._head_key))
1929
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
1930
            head_rev = self._head_key[-1]
1931
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1932
            return ((plan, line) for line in lines)
1933
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
1934
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1935
1936
class _PlanLCAMerge(_PlanMergeBase):
1937
    """
3144.3.7 by Aaron Bentley
Update from review
1938
    This merge algorithm differs from _PlanMerge in that:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1939
    1. comparisons are done against LCAs only
1940
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
1941
       another are marked as conflicts, by emitting the line as conflicted-a
1942
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1943
1944
    This is faster, and hopefully produces more useful output.
1945
    """
1946
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1947
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
1948
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
1949
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
1950
        self.lcas = set()
1951
        for lca in lcas:
1952
            if lca == NULL_REVISION:
1953
                self.lcas.add(lca)
1954
            else:
1955
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
1956
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
1957
            if _mod_revision.is_null(lca):
1958
                lca_lines = []
1959
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
1960
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
1961
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
1962
                                                           lca_lines)
1963
            blocks = list(matcher.get_matching_blocks())
1964
            self._cached_matching_blocks[(a_rev, lca)] = blocks
1965
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
1966
                                                           lca_lines)
1967
            blocks = list(matcher.get_matching_blocks())
1968
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1969
3144.3.7 by Aaron Bentley
Update from review
1970
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1971
        """Determines the status unique lines versus all lcas.
1972
1973
        Basically, determines why the line is unique to this revision.
1974
1975
        A line may be determined new, killed, or both.
1976
3144.3.7 by Aaron Bentley
Update from review
1977
        If a line is determined new, that means it was not present in at least
1978
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1979
1980
        If a line is determined killed, that means the line was present in
1981
        at least one LCA.
1982
1983
        If a line is killed and new, this indicates that the two merge
1984
        revisions contain differing conflict resolutions.
3144.3.7 by Aaron Bentley
Update from review
1985
        :param revision_id: The id of the revision in which the lines are
1986
            unique
1987
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1988
        :return a tuple of (new_this, killed_other):
1989
        """
1990
        new = set()
1991
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
1992
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1993
        for lca in self.lcas:
1994
            blocks = self._get_matching_blocks(revision_id, lca)
1995
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
1996
            new.update(unique_line_numbers.intersection(unique_vs_lca))
1997
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1998
        return new, killed