/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1
# Copyright (C) 2005, 2006, 2008 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
17
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
18
import errno
19
from itertools import chain
1185.1.2 by Martin Pool
- merge various windows and other fixes from Ollie Rutherfurd
20
import os
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
21
import warnings
1113 by Martin Pool
- fix is_ancestor import problem in merge
22
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
23
from bzrlib import (
1551.19.17 by Aaron Bentley
Add debugging flag for merges
24
    debug,
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
25
    errors,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
26
    graph as _mod_graph,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
27
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
28
    patiencediff,
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
29
    registry,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
30
    revision as _mod_revision,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
31
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
32
    tsort,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
33
    )
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
34
from bzrlib.branch import Branch
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
35
from bzrlib.conflicts import ConflictList, Conflict
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
36
from bzrlib.errors import (BzrCommandError,
1534.4.28 by Robert Collins
first cut at merge from integration.
37
                           BzrError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
38
                           NoCommonAncestor,
39
                           NoCommits,
1534.4.28 by Robert Collins
first cut at merge from integration.
40
                           NoSuchRevision,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
41
                           NoSuchFile,
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
42
                           NotBranchError,
1185.33.27 by Martin Pool
[merge] much integrated work from robert and john
43
                           NotVersionedError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
44
                           UnrelatedBranches,
1534.10.12 by Aaron Bentley
Merge produces new conflicts
45
                           UnsupportedOperation,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
46
                           WorkingTreeNotRevision,
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
47
                           BinaryFile,
1534.4.28 by Robert Collins
first cut at merge from integration.
48
                           )
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
49
from bzrlib.graph import Graph
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
50
from bzrlib.merge3 import Merge3
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
51
from bzrlib.osutils import rename, pathjoin
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
52
from progress import DummyProgress, ProgressPhase
3052.1.3 by John Arbash Meinel
deprecate revision.is_ancestor, update the callers and the tests.
53
from bzrlib.revision import (NULL_REVISION, ensure_null)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
54
from bzrlib.textfile import check_text_lines
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
55
from bzrlib.trace import mutter, warning, note, is_quiet
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
56
from bzrlib.transform import (TransformPreview, TreeTransform,
57
                              resolve_conflicts, cook_conflicts,
2590.2.8 by Aaron Bentley
Restore conflict handling changes
58
                              conflict_pass, FinalPaths, create_by_entry,
59
                              unique_add, ROOT_PARENT)
1551.15.46 by Aaron Bentley
Move plan merge to tree
60
from bzrlib.versionedfile import PlanWeaveMerge
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
61
from bzrlib import ui
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
62
63
# TODO: Report back as changes are merged in
64
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
65
1185.35.4 by Aaron Bentley
Implemented remerge
66
def transform_tree(from_tree, to_tree, interesting_ids=None):
67
    merge_inner(from_tree.branch, to_tree, from_tree, ignore_zero=True,
1558.1.3 by Aaron Bentley
Fixed deprecated op use in test suite
68
                interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
69
1457.1.12 by Robert Collins
Update comment to reflect author.
70
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
71
class Merger(object):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
72
    def __init__(self, this_branch, other_tree=None, base_tree=None,
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
73
                 this_tree=None, pb=DummyProgress(), change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
74
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
75
        object.__init__(self)
76
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
77
        self.this_basis = _mod_revision.ensure_null(
78
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
79
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
80
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
81
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
82
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
83
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
84
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
85
        self.base_tree = base_tree
86
        self.ignore_zero = False
87
        self.backup_files = False
88
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
89
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
90
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
91
        self.reprocess = False
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
92
        self._pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
93
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
94
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
95
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
96
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
97
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
98
        self._base_is_ancestor = None
99
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
100
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
101
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
102
103
    @property
104
    def revision_graph(self):
105
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
106
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
107
        return self._revision_graph
108
109
    def _set_base_is_ancestor(self, value):
110
        self._base_is_ancestor = value
111
112
    def _get_base_is_ancestor(self):
113
        if self._base_is_ancestor is None:
114
            self._base_is_ancestor = self.revision_graph.is_ancestor(
115
                self.base_rev_id, self.this_basis)
116
        return self._base_is_ancestor
117
118
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
119
120
    def _set_base_is_other_ancestor(self, value):
121
        self._base_is_other_ancestor = value
122
123
    def _get_base_is_other_ancestor(self):
124
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
125
            if self.other_basis is None:
126
                return True
127
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
128
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
129
        return self._base_is_other_ancestor
130
131
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
132
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
133
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
134
    @staticmethod
135
    def from_uncommitted(tree, other_tree, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
136
        """Return a Merger for uncommitted changes in other_tree.
137
138
        :param tree: The tree to merge into
139
        :param other_tree: The tree to get uncommitted changes from
140
        :param pb: A progress indicator
141
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
142
        merger = Merger(tree.branch, other_tree, other_tree.basis_tree(), tree,
143
                        pb)
144
        merger.base_rev_id = merger.base_tree.get_revision_id()
145
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
146
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
147
        return merger
148
149
    @classmethod
150
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
151
        """Return a Merger for a bundle or merge directive.
152
153
        :param tree: The tree to merge changes into
154
        :param mergeable: A merge directive or bundle
155
        :param pb: A progress indicator
156
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
157
        mergeable.install_revisions(tree.branch.repository)
158
        base_revision_id, other_revision_id, verified =\
159
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
160
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
161
        if base_revision_id is not None:
162
            if (base_revision_id != _mod_revision.NULL_REVISION and
163
                revision_graph.is_ancestor(
164
                base_revision_id, tree.branch.last_revision())):
165
                base_revision_id = None
166
            else:
167
                warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
168
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
169
                                         base_revision_id, revision_graph=
170
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
171
        return merger, verified
172
173
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
174
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
175
                          base_branch=None, revision_graph=None,
176
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
177
        """Return a Merger for revision-ids.
178
179
        :param tree: The tree to merge changes into
180
        :param other: The revision-id to use as OTHER
181
        :param base: The revision-id to use as BASE.  If not specified, will
182
            be auto-selected.
183
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
184
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
185
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
186
            not supplied, other_branch or tree.branch will be used.
187
        :param revision_graph: If you have a revision_graph precomputed, pass
188
            it in, otherwise it will be created for you.
1551.15.74 by Aaron Bentley
Textual updates from review
189
        :param pb: A progress indicator
190
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
191
        if tree_branch is None:
192
            tree_branch = tree.branch
193
        merger = Merger(tree_branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
194
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
195
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
196
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
197
        merger.set_other_revision(other, other_branch)
198
        if base is None:
199
            merger.find_base()
200
        else:
201
            if base_branch is None:
202
                base_branch = other_branch
203
            merger.set_base_revision(base, base_branch)
204
        return merger
205
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
206
    def revision_tree(self, revision_id, branch=None):
207
        if revision_id not in self._cached_trees:
208
            if branch is None:
209
                branch = self.this_branch
210
            try:
211
                tree = self.this_tree.revision_tree(revision_id)
212
            except errors.NoSuchRevisionInTree:
213
                tree = branch.repository.revision_tree(revision_id)
214
            self._cached_trees[revision_id] = tree
215
        return self._cached_trees[revision_id]
216
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
217
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
218
        from bzrlib import workingtree
219
        location, revno = treespec
220
        if revno is None:
221
            tree = workingtree.WorkingTree.open_containing(location)[0]
222
            return tree.branch, tree
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
223
        branch = Branch.open_containing(location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
224
        if revno == -1:
225
            revision_id = branch.last_revision()
226
        else:
227
            revision_id = branch.get_rev_id(revno)
228
        revision_id = ensure_null(revision_id)
229
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
230
231
    def ensure_revision_trees(self):
232
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
233
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
234
            if self.this_basis == self.this_rev_id:
235
                self.this_revision_tree = self.this_basis_tree
236
1185.12.83 by Aaron Bentley
Preliminary weave merge support
237
        if self.other_rev_id is None:
238
            other_basis_tree = self.revision_tree(self.other_basis)
1852.10.3 by Robert Collins
Remove all uses of compare_trees and replace with Tree.changes_from throughout bzrlib.
239
            changes = other_basis_tree.changes_from(self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
240
            if changes.has_changed():
241
                raise WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
242
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
243
            self.other_tree = other_basis_tree
244
245
    def file_revisions(self, file_id):
246
        self.ensure_revision_trees()
247
        def get_id(tree, file_id):
248
            revision_id = tree.inventory[file_id].revision
249
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
250
        if self.this_rev_id is None:
251
            if self.this_basis_tree.get_file_sha1(file_id) != \
252
                self.this_tree.get_file_sha1(file_id):
253
                raise WorkingTreeNotRevision(self.this_tree)
254
255
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
256
        return [get_id(tree, file_id) for tree in trees]
257
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
258
    def check_basis(self, check_clean, require_commits=True):
259
        if self.this_basis is None and require_commits is True:
2249.3.1 by John Arbash Meinel
Mention using 'bzr pull' if there are no commits in current branch
260
            raise BzrCommandError("This branch has no commits."
261
                                  " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
262
        if check_clean:
263
            self.compare_basis()
264
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
265
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
266
267
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
268
        try:
269
            basis_tree = self.revision_tree(self.this_tree.last_revision())
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
270
        except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
271
            basis_tree = self.this_tree.basis_tree()
272
        changes = self.this_tree.changes_from(basis_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
273
        if not changes.has_changed():
274
            self.this_rev_id = self.this_basis
275
276
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
277
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
278
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
279
    def set_pending(self):
2644.1.1 by Wouter van Heyst
Fix bug #127115 by checking for self.other_rev_id being None in Merger.set_pending()
280
        if not self.base_is_ancestor or not self.base_is_other_ancestor or self.other_rev_id is None:
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
281
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
282
        self._add_parent()
283
284
    def _add_parent(self):
285
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
286
        new_parent_trees = []
287
        for revision_id in new_parents:
288
            try:
289
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
290
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
291
                tree = None
292
            else:
293
                tree.lock_read()
294
            new_parent_trees.append((revision_id, tree))
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
295
        try:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
296
            self.this_tree.set_parent_trees(new_parent_trees,
297
                                            allow_leftmost_as_ghost=True)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
298
        finally:
299
            for _revision_id, tree in new_parent_trees:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
300
                if tree is not None:
301
                    tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
302
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
303
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
304
        """Set the revision and tree to merge from.
305
306
        This sets the other_tree, other_rev_id, other_basis attributes.
307
308
        :param other_revision: The [path, revision] list to merge from.
309
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
310
        self.other_branch, self.other_tree = self._get_tree(other_revision,
311
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
312
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
313
            self.other_rev_id = _mod_revision.ensure_null(
314
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
315
            if _mod_revision.is_null(self.other_rev_id):
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
316
                raise NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
317
            self.other_basis = self.other_rev_id
318
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
319
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
320
            self.other_basis = self.other_rev_id
321
        else:
322
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
323
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
324
            if self.other_basis is None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
325
                raise NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
326
        if self.other_rev_id is not None:
327
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
328
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
329
2100.3.29 by Aaron Bentley
Get merge working initially
330
    def set_other_revision(self, revision_id, other_branch):
331
        """Set 'other' based on a branch and revision id
332
333
        :param revision_id: The revision to use for a tree
334
        :param other_branch: The branch containing this tree
335
        """
336
        self.other_rev_id = revision_id
337
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
338
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
339
        self.other_tree = self.revision_tree(revision_id)
340
        self.other_basis = revision_id
341
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
342
    def set_base_revision(self, revision_id, branch):
343
        """Set 'base' based on a branch and revision id
344
345
        :param revision_id: The revision to use for a tree
346
        :param branch: The branch containing this tree
347
        """
348
        self.base_rev_id = revision_id
349
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
350
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
351
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
352
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
353
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
354
        if not source.repository.has_same_location(target.repository):
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
355
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
356
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
357
    def find_base(self):
2590.2.22 by Aaron Bentley
Remove cruft
358
        revisions = [ensure_null(self.this_basis),
359
                     ensure_null(self.other_basis)]
360
        if NULL_REVISION in revisions:
361
            self.base_rev_id = NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
362
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
363
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
364
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
365
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
366
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
367
            if len(lcas) == 0:
368
                self.base_rev_id = NULL_REVISION
369
            elif len(lcas) == 1:
370
                self.base_rev_id = list(lcas)[0]
371
            else: # len(lcas) > 1
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
372
                if len(lcas) > 2:
373
                    # find_unique_lca can only handle 2 nodes, so we have to
374
                    # start back at the beginning. It is a shame to traverse
375
                    # the graph again, but better than re-implementing
376
                    # find_unique_lca.
377
                    self.base_rev_id = self.revision_graph.find_unique_lca(
378
                                            revisions[0], revisions[1])
379
                else:
380
                    self.base_rev_id = self.revision_graph.find_unique_lca(
381
                                            *lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
382
                self._is_criss_cross = True
2590.2.22 by Aaron Bentley
Remove cruft
383
            if self.base_rev_id == NULL_REVISION:
384
                raise UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
385
            if self._is_criss_cross:
1551.19.11 by Aaron Bentley
Add criss-cross help topic
386
                warning('Warning: criss-cross merge encountered.  See bzr'
387
                        ' help criss-cross.')
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
388
                interesting_revision_ids = [self.base_rev_id]
389
                interesting_revision_ids.extend(lcas)
390
                interesting_trees = dict((t.get_revision_id(), t)
391
                    for t in self.this_branch.repository.revision_trees(
392
                        interesting_revision_ids))
393
                self._cached_trees.update(interesting_trees)
394
                self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
395
                sorted_lca_keys = self.revision_graph.find_merge_order(
396
                    revisions[0], lcas)
397
                self._lca_trees = [interesting_trees[key]
398
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
399
            else:
400
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
401
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
402
        self.base_is_other_ancestor = True
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
403
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
404
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
405
        """Set the base revision to use for the merge.
406
407
        :param base_revision: A 2-list containing a path and revision number.
408
        """
1185.12.96 by Aaron Bentley
Merge from mpool
409
        mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
410
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
411
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
412
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
413
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
414
            if base_revision[1] == -1:
415
                self.base_rev_id = base_branch.last_revision()
416
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
417
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
418
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
419
                self.base_rev_id = _mod_revision.ensure_null(
420
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
421
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
422
3008.1.8 by Michael Hudson
extract merger creation into a method
423
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
424
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
425
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
426
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
427
                  'interesting_files': self.interesting_files,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
428
                  'pp': self.pp,
429
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
430
        if self.merge_type.requires_base:
431
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
432
        if self.merge_type.supports_reprocess:
433
            kwargs['reprocess'] = self.reprocess
434
        elif self.reprocess:
1551.6.14 by Aaron Bentley
Tweaks from merge review
435
            raise BzrError("Conflict reduction is not supported for merge"
436
                                  " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
437
        if self.merge_type.supports_show_base:
438
            kwargs['show_base'] = self.show_base
439
        elif self.show_base:
1534.8.2 by Aaron Bentley
Implemented weave merge
440
            raise BzrError("Showing base is not supported for this"
3008.1.14 by Michael Hudson
trivial commit for testing
441
                           " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
442
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
443
            and not self.base_is_other_ancestor):
444
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
445
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
446
            kwargs['cherrypick'] = (not self.base_is_ancestor or
447
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
448
        if self._is_criss_cross and getattr(self.merge_type,
449
                                            'supports_lca_trees', False):
450
            kwargs['lca_trees'] = self._lca_trees
3008.1.8 by Michael Hudson
extract merger creation into a method
451
        return self.merge_type(pb=self._pb,
452
                               change_reporter=self.change_reporter,
453
                               **kwargs)
454
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
455
    def _do_merge_to(self, merge):
456
        merge.do_merge()
457
        if self.recurse == 'down':
458
            for relpath, file_id in self.this_tree.iter_references():
459
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
460
                other_revision = self.other_tree.get_reference_revision(
461
                    file_id, relpath)
462
                if  other_revision == sub_tree.last_revision():
463
                    continue
464
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
465
                sub_merge.merge_type = self.merge_type
466
                other_branch = self.other_branch.reference_parent(file_id, relpath)
467
                sub_merge.set_other_revision(other_revision, other_branch)
468
                base_revision = self.base_tree.get_reference_revision(file_id)
469
                sub_merge.base_tree = \
470
                    sub_tree.branch.repository.revision_tree(base_revision)
471
                sub_merge.base_rev_id = base_revision
472
                sub_merge.do_merge()
473
        
3008.1.8 by Michael Hudson
extract merger creation into a method
474
    def do_merge(self):
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
475
        self.this_tree.lock_tree_write()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
476
        try:
477
            if self.base_tree is not None:
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
478
                self.base_tree.lock_read()
479
            try:
480
                if self.other_tree is not None:
481
                    self.other_tree.lock_read()
482
                try:
483
                    merge = self.make_merger()
484
                    self._do_merge_to(merge)
485
                finally:
486
                    if self.other_tree is not None:
487
                        self.other_tree.unlock()
488
            finally:
489
                if self.base_tree is not None:
490
                    self.base_tree.unlock()
491
        finally:
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
492
            self.this_tree.unlock()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
493
        if len(merge.cooked_conflicts) == 0:
3200.1.1 by James Westby
Make pull --quiet more quiet. Fixes #185907.
494
            if not self.ignore_zero and not is_quiet():
1534.7.141 by Aaron Bentley
Added conflict reporting
495
                note("All changes applied successfully.")
496
        else:
497
            note("%d conflicts encountered." % len(merge.cooked_conflicts))
498
1534.7.134 by Aaron Bentley
Hid raw conflicts
499
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
500
1545.2.4 by Aaron Bentley
PEP8 fixes
501
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
502
class _InventoryNoneEntry(object):
503
    """This represents an inventory entry which *isn't there*.
504
505
    It simplifies the merging logic if we always have an InventoryEntry, even
506
    if it isn't actually present
507
    """
508
    executable = None
509
    kind = None
510
    name = None
511
    parent_id = None
512
    revision = None
513
    symlink_target = None
514
    text_sha1 = None
515
516
_none_entry = _InventoryNoneEntry()
517
518
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
519
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
520
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
521
    requires_base = True
522
    supports_reprocess = True
523
    supports_show_base = True
524
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
525
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
526
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
527
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
528
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
529
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
530
    def __init__(self, working_tree, this_tree, base_tree, other_tree, 
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
531
                 interesting_ids=None, reprocess=False, show_base=False,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
532
                 pb=DummyProgress(), pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
533
                 interesting_files=None, do_merge=True,
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
534
                 cherrypick=False, lca_trees=None):
2590.2.10 by Aaron Bentley
Updates from review
535
        """Initialize the merger object and perform the merge.
536
537
        :param working_tree: The working tree to apply the merge to
538
        :param this_tree: The local tree in the merge operation
539
        :param base_tree: The common tree in the merge operation
540
        :param other_tree: The other other tree to merge changes from
541
        :param interesting_ids: The file_ids of files that should be
542
            participate in the merge.  May not be combined with
543
            interesting_files.
544
        :param: reprocess If True, perform conflict-reduction processing.
545
        :param show_base: If True, show the base revision in text conflicts.
546
            (incompatible with reprocess)
547
        :param pb: A Progress bar
548
        :param pp: A ProgressPhase object
549
        :param change_reporter: An object that should report changes made
550
        :param interesting_files: The tree-relative paths of files that should
551
            participate in the merge.  If these paths refer to directories,
552
            the contents of those directories will also be included.  May not
553
            be combined with interesting_ids.  If neither interesting_files nor
554
            interesting_ids is specified, all files may participate in the
555
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
556
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
557
            if the ancestry was found to include a criss-cross merge.
558
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
559
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
560
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
561
        if interesting_files is not None and interesting_ids is not None:
562
            raise ValueError(
563
                'specify either interesting_ids or interesting_files')
2590.2.4 by Aaron Bentley
Move entry generation to a helper
564
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
565
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
566
        self.this_tree = working_tree
567
        self.base_tree = base_tree
568
        self.other_tree = other_tree
569
        self._raw_conflicts = []
570
        self.cooked_conflicts = []
571
        self.reprocess = reprocess
572
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
573
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
574
        # Uncommenting this will change the default algorithm to always use
575
        # _entries_lca. This can be useful for running the test suite and
576
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
577
        # if lca_trees is None:
578
        #     self._lca_trees = [self.base_tree]
1534.9.1 by Aaron Bentley
Added progress bars to merge
579
        self.pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
580
        self.pp = pp
1551.11.9 by Aaron Bentley
Apply change reporting to merge
581
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
582
        self.cherrypick = cherrypick
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
583
        if self.pp is None:
584
            self.pp = ProgressPhase("Merge phase", 3, self.pb)
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
585
        if do_merge:
586
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
587
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
588
    def do_merge(self):
589
        self.this_tree.lock_tree_write()
590
        self.base_tree.lock_read()
591
        self.other_tree.lock_read()
592
        self.tt = TreeTransform(self.this_tree, self.pb)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
593
        try:
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
594
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
595
            self._compute_transform()
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
596
            self.pp.next_phase()
2590.2.17 by Aaron Bentley
Avoid redundant conflict check
597
            results = self.tt.apply(no_conflicts=True)
1558.4.3 by Aaron Bentley
Merge_modified performance/concurrency fix
598
            self.write_modified(results)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
599
            try:
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
600
                self.this_tree.add_conflicts(self.cooked_conflicts)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
601
            except UnsupportedOperation:
602
                pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
603
        finally:
1711.7.7 by John Arbash Meinel
Don't squelch errors in tt.finalize()
604
            self.tt.finalize()
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
605
            self.other_tree.unlock()
606
            self.base_tree.unlock()
607
            self.this_tree.unlock()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
608
            self.pb.clear()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
609
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
610
    def make_preview_transform(self):
611
        self.base_tree.lock_read()
612
        self.other_tree.lock_read()
613
        self.tt = TransformPreview(self.this_tree)
614
        try:
615
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
616
            self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
617
            self.pp.next_phase()
618
        finally:
619
            self.other_tree.unlock()
620
            self.base_tree.unlock()
621
            self.pb.clear()
622
        return self.tt
623
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
624
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
625
        if self._lca_trees is None:
626
            entries = self._entries3()
627
            resolver = self._three_way
628
        else:
629
            entries = self._entries_lca()
630
            resolver = self._lca_multi_way
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
631
        child_pb = ui.ui_factory.nested_progress_bar()
632
        try:
633
            for num, (file_id, changed, parents3, names3,
634
                      executable3) in enumerate(entries):
635
                child_pb.update('Preparing file merge', num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
636
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
637
                if changed:
638
                    file_status = self.merge_contents(file_id)
639
                else:
640
                    file_status = 'unmodified'
641
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
642
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
643
        finally:
644
            child_pb.finished()
645
        self.fix_root()
646
        self.pp.next_phase()
647
        child_pb = ui.ui_factory.nested_progress_bar()
648
        try:
649
            fs_conflicts = resolve_conflicts(self.tt, child_pb,
650
                lambda t, c: conflict_pass(t, c, self.other_tree))
651
        finally:
652
            child_pb.finished()
653
        if self.change_reporter is not None:
654
            from bzrlib import delta
655
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
656
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
657
        self.cook_conflicts(fs_conflicts)
658
        for conflict in self.cooked_conflicts:
659
            warning(conflict)
660
2590.2.4 by Aaron Bentley
Move entry generation to a helper
661
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
662
        """Gather data about files modified between three trees.
663
664
        Return a list of tuples of file_id, changed, parents3, names3,
665
        executable3.  changed is a boolean indicating whether the file contents
666
        or kind were changed.  parents3 is a tuple of parent ids for base,
667
        other and this.  names3 is a tuple of names for base, other and this.
668
        executable3 is a tuple of execute-bit values for base, other and this.
669
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
670
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
671
        iterator = self.other_tree.iter_changes(self.base_tree,
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
672
                include_unchanged=True, specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
673
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
674
        this_entries = dict((e.file_id, e) for p, e in
675
                            self.this_tree.iter_entries_by_dir(
676
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
677
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
678
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
679
            if (self.interesting_ids is not None and
680
                file_id not in self.interesting_ids):
681
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
682
            entry = this_entries.get(file_id)
683
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
684
                this_name = entry.name
685
                this_parent = entry.parent_id
686
                this_executable = entry.executable
687
            else:
688
                this_name = None
689
                this_parent = None
690
                this_executable = None
691
            parents3 = parents + (this_parent,)
692
            names3 = names + (this_name,)
693
            executable3 = executable + (this_executable,)
694
            result.append((file_id, changed, parents3, names3, executable3))
695
        return result
696
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
697
    def _entries_lca(self):
698
        """Gather data about files modified between multiple trees.
699
700
        This compares OTHER versus all LCA trees, and for interesting entries,
701
        it then compares with THIS and BASE.
702
703
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
704
        :return: [(file_id, changed, parents, names, executable)]
705
            file_id     Simple file_id of the entry
706
            changed     Boolean, True if the kind or contents changed
707
                        else False
708
            parents     ((base, [parent_id, in, lcas]), parent_id_other,
709
                         parent_id_this)
710
            names       ((base, [name, in, lcas]), name_in_other, name_in_this)
711
            executable  ((base, [exec, in, lcas]), exec_in_other, exec_in_this)
712
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
713
        if self.interesting_files is not None:
714
            lookup_trees = [self.this_tree, self.base_tree]
715
            lookup_trees.extend(self._lca_trees)
716
            # I think we should include the lca trees as well
717
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
718
                                                        lookup_trees)
719
        else:
720
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
721
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
722
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
723
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
724
        base_inventory = self.base_tree.inventory
725
        this_inventory = self.this_tree.inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
726
        for path, file_id, other_ie, lca_values in walker.iter_all():
727
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
728
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
729
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
730
            if interesting_ids is not None and file_id not in interesting_ids:
731
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
732
3514.4.30 by John Arbash Meinel
Several updates.
733
            # If other_revision is found in any of the lcas, that means this
734
            # node is uninteresting. This is because when merging, if there are
735
            # multiple heads(), we have to create a new node. So if we didn't,
736
            # we know that the ancestry is linear, and that OTHER did not
737
            # modify anything
738
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
739
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
740
            if other_revision is not None:
741
                # We can't use this shortcut when other_revision is None,
742
                # because it may be None because things are WorkingTrees, and
743
                # not because it is *actually* None.
744
                is_unmodified = False
745
                for lca_path, ie in lca_values:
746
                    if ie is not None and ie.revision == other_revision:
747
                        is_unmodified = True
748
                        break
749
                if is_unmodified:
750
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
751
752
            lca_entries = []
753
            for lca_path, lca_ie in lca_values:
754
                if lca_ie is None:
755
                    lca_entries.append(_none_entry)
756
                else:
757
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
758
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
759
            if file_id in base_inventory:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
760
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
761
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
762
                base_ie = _none_entry
763
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
764
            if file_id in this_inventory:
765
                this_ie = this_inventory[file_id]
766
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
767
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
768
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
769
            lca_kinds = []
770
            lca_parent_ids = []
771
            lca_names = []
772
            lca_executable = []
773
            for lca_ie in lca_entries:
774
                lca_kinds.append(lca_ie.kind)
775
                lca_parent_ids.append(lca_ie.parent_id)
776
                lca_names.append(lca_ie.name)
777
                lca_executable.append(lca_ie.executable)
778
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
779
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
780
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
781
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
782
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
783
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
784
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
785
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
786
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
787
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
788
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
789
            content_changed = True
790
            if kind_winner == 'this':
791
                # No kind change in OTHER, see if there are *any* changes
792
                if other_ie.kind == None:
793
                    # No content and 'this' wins the kind, so skip this?
794
                    # continue
795
                    pass
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
796
                elif other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
797
                    if parent_id_winner == 'this' and name_winner == 'this':
798
                        # No change for this directory in OTHER, skip
799
                        continue
800
                    content_changed = False
801
                elif other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
802
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
803
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
804
                            return None
805
                        return tree.get_file_sha1(file_id)
806
                    base_sha1 = get_sha1(base_ie, self.base_tree)
807
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
808
                                 in zip(lca_entries, self._lca_trees)]
809
                    this_sha1 = get_sha1(this_ie, self.this_tree)
810
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
811
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
812
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
813
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
814
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
815
                        (base_ie.executable, lca_executable),
816
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
817
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
818
                        and sha1_winner == 'this' and exec_winner == 'this'):
819
                        # No kind, parent, name, exec, or content change for
820
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
821
                        continue
822
                    if sha1_winner == 'this':
823
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
824
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
825
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
826
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
827
                            return None
828
                        return tree.get_symlink_target(file_id)
829
                    base_target = get_target(base_ie, self.base_tree)
830
                    lca_targets = [get_target(ie, tree) for ie, tree
831
                                   in zip(lca_entries, self._lca_trees)]
832
                    this_target = get_target(this_ie, self.this_tree)
833
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
834
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
835
                        (base_target, lca_targets),
836
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
837
                    if (parent_id_winner == 'this' and name_winner == 'this'
838
                        and target_winner == 'this'):
839
                        # No kind, parent, name, or symlink target change
840
                        # not interesting
841
                        continue
842
                    if target_winner == 'this':
843
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
844
                elif other_ie.kind == 'tree-reference':
845
                    # The 'changed' information seems to be handled at a higher
846
                    # level. At least, _entries3 returns False for content
847
                    # changed, even when at a new revision_id.
848
                    content_changed = False
849
                    if (parent_id_winner == 'this' and name_winner == 'this'):
850
                        # Nothing interesting
851
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
852
                else:
853
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
854
                # XXX: We need to handle kind == 'symlink'
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
855
856
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
857
            result.append((file_id, content_changed,
858
                           ((base_ie.parent_id, lca_parent_ids),
859
                            other_ie.parent_id, this_ie.parent_id),
860
                           ((base_ie.name, lca_names),
861
                            other_ie.name, this_ie.name),
862
                           ((base_ie.executable, lca_executable),
863
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
864
                          ))
865
        return result
866
867
1731.1.33 by Aaron Bentley
Revert no-special-root changes
868
    def fix_root(self):
869
        try:
870
            self.tt.final_kind(self.tt.root)
871
        except NoSuchFile:
872
            self.tt.cancel_deletion(self.tt.root)
873
        if self.tt.final_file_id(self.tt.root) is None:
874
            self.tt.version_file(self.tt.tree_file_id(self.tt.root), 
875
                                 self.tt.root)
876
        if self.other_tree.inventory.root is None:
877
            return
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
878
        other_root_file_id = self.other_tree.get_root_id()
1731.1.33 by Aaron Bentley
Revert no-special-root changes
879
        other_root = self.tt.trans_id_file_id(other_root_file_id)
880
        if other_root == self.tt.root:
881
            return
882
        try:
883
            self.tt.final_kind(other_root)
884
        except NoSuchFile:
885
            return
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
886
        if self.other_tree.inventory.root.file_id in self.this_tree.inventory:
887
            # the other tree's root is a non-root in the current tree
888
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
889
        self.reparent_children(self.other_tree.inventory.root, self.tt.root)
890
        self.tt.cancel_creation(other_root)
891
        self.tt.cancel_versioning(other_root)
892
893
    def reparent_children(self, ie, target):
894
        for thing, child in ie.children.iteritems():
895
            trans_id = self.tt.trans_id_file_id(child.file_id)
896
            self.tt.adjust_path(self.tt.final_name(trans_id), target, trans_id)
897
1534.7.192 by Aaron Bentley
Record hashes produced by merges
898
    def write_modified(self, results):
899
        modified_hashes = {}
900
        for path in results.modified_paths:
901
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
902
            if file_id is None:
903
                continue
904
            hash = self.this_tree.get_file_sha1(file_id)
905
            if hash is None:
906
                continue
907
            modified_hashes[file_id] = hash
908
        self.this_tree.set_merge_modified(modified_hashes)
909
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
910
    @staticmethod
911
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
912
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
913
        if entry is None:
914
            return None
915
        return entry.parent_id
916
917
    @staticmethod
918
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
919
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
920
        if entry is None:
921
            return None
922
        return entry.name
923
    
924
    @staticmethod
925
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
926
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
927
        if file_id not in tree:
928
            return None
929
        return tree.get_file_sha1(file_id)
930
931
    @staticmethod
932
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
933
        """Determine the executability of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
934
        if file_id not in tree:
935
            return None
936
        if tree.kind(file_id) != "file":
937
            return False
938
        return tree.is_executable(file_id)
939
940
    @staticmethod
941
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
942
        """Determine the kind of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
943
        if file_id not in tree:
944
            return None
945
        return tree.kind(file_id)
946
947
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
948
    def _three_way(base, other, this):
949
        #if base == other, either they all agree, or only THIS has changed.
950
        if base == other:
951
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
952
        elif this not in (base, other):
2590.2.8 by Aaron Bentley
Restore conflict handling changes
953
            return 'conflict'
2590.2.10 by Aaron Bentley
Updates from review
954
        # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
955
        elif this == other:
956
            return "this"
2590.2.10 by Aaron Bentley
Updates from review
957
        # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
958
        else:
959
            return "other"
960
961
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
962
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
963
        """Consider LCAs when determining whether a change has occurred.
964
965
        If LCAS are all identical, this is the same as a _three_way comparison.
966
967
        :param bases: value in (BASE, [LCAS])
968
        :param other: value in OTHER
969
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
970
        :param allow_overriding_lca: If there is more than one unique lca
971
            value, allow OTHER to override THIS if it has a new value, and
972
            THIS only has an lca value, or vice versa. This is appropriate for
973
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
974
        :return: 'this', 'other', or 'conflict' depending on whether an entry
975
            changed or not.
976
        """
3514.4.30 by John Arbash Meinel
Several updates.
977
        # See doc/developers/lca_merge_resolution.txt for details about this
978
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
979
        if other == this:
980
            # Either Ambiguously clean, or nothing was actually changed. We
981
            # don't really care
982
            return 'this'
983
        base_val, lca_vals = bases
984
        # Remove 'base_val' from the lca_vals, because it is not interesting
985
        filtered_lca_vals = [lca_val for lca_val in lca_vals
986
                                      if lca_val != base_val]
987
        if len(filtered_lca_vals) == 0:
988
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
989
990
        unique_lca_vals = set(filtered_lca_vals)
991
        if len(unique_lca_vals) == 1:
992
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
993
994
        if allow_overriding_lca:
995
            if other in unique_lca_vals:
996
                if this in unique_lca_vals:
997
                    # Each side picked a different lca, conflict
998
                    return 'conflict'
999
                else:
1000
                    # This has a value which supersedes both lca values, and
1001
                    # other only has an lca value
1002
                    return 'this'
1003
            elif this in unique_lca_vals:
1004
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1005
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1006
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1007
1008
        # At this point, the lcas disagree, and the tips disagree
1009
        return 'conflict'
1010
1011
    @staticmethod
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1012
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
1013
        """Do a three-way test on a scalar.
1014
        Return "this", "other" or "conflict", depending whether a value wins.
1015
        """
1016
        key_base = key(base_tree, file_id)
1017
        key_other = key(other_tree, file_id)
1018
        #if base == other, either they all agree, or only THIS has changed.
1019
        if key_base == key_other:
1020
            return "this"
1021
        key_this = key(this_tree, file_id)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1022
        # "Ambiguous clean merge"
1023
        if key_this == key_other:
1024
            return "this"
1025
        elif key_this == key_base:
1026
            return "other"
1027
        else:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1028
            return "conflict"
1029
1030
    def merge_names(self, file_id):
1031
        def get_entry(tree):
1032
            if file_id in tree.inventory:
1033
                return tree.inventory[file_id]
1034
            else:
1035
                return None
1036
        this_entry = get_entry(self.this_tree)
1037
        other_entry = get_entry(self.other_tree)
1038
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1039
        entries = (base_entry, other_entry, this_entry)
1040
        names = []
1041
        parents = []
1042
        for entry in entries:
1043
            if entry is None:
1044
                names.append(None)
1045
                parents.append(None)
1046
            else:
1047
                names.append(entry.name)
1048
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1049
        return self._merge_names(file_id, parents, names,
1050
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1051
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1052
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1053
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1054
        base_name, other_name, this_name = names
1055
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1056
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1057
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1058
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1059
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1060
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1061
            if name_winner == "this":
1062
                name_winner = "other"
1063
            if parent_id_winner == "this":
1064
                parent_id_winner = "other"
1065
        if name_winner == "this" and parent_id_winner == "this":
1066
            return
1067
        if name_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1068
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1069
            self._raw_conflicts.append(('name conflict', trans_id, 
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1070
                                        this_name, other_name))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1071
        if parent_id_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1072
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1073
            self._raw_conflicts.append(('parent conflict', trans_id, 
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1074
                                        this_parent, other_parent))
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1075
        if other_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1076
            # it doesn't matter whether the result was 'other' or 
1077
            # 'conflict'-- if there's no 'other', we leave it alone.
1078
            return
1079
        # if we get here, name_winner and parent_winner are set to safe values.
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1080
        trans_id = self.tt.trans_id_file_id(file_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1081
        parent_id = parents[self.winner_idx[parent_id_winner]]
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1082
        if parent_id is not None:
1083
            parent_trans_id = self.tt.trans_id_file_id(parent_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1084
            self.tt.adjust_path(names[self.winner_idx[name_winner]],
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1085
                                parent_trans_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1086
1087
    def merge_contents(self, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1088
        """Performa a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1089
        def contents_pair(tree):
1090
            if file_id not in tree:
1091
                return (None, None)
1092
            kind = tree.kind(file_id)
1093
            if kind == "file":
1094
                contents = tree.get_file_sha1(file_id)
1095
            elif kind == "symlink":
1096
                contents = tree.get_symlink_target(file_id)
1097
            else:
1098
                contents = None
1099
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1100
1101
        def contents_conflict():
1102
            trans_id = self.tt.trans_id_file_id(file_id)
1103
            name = self.tt.final_name(trans_id)
1104
            parent_id = self.tt.final_parent(trans_id)
1105
            if file_id in self.this_tree.inventory:
1106
                self.tt.unversion_file(trans_id)
1551.10.2 by Aaron Bentley
Handle merge with dangling inventory entries
1107
                if file_id in self.this_tree:
1108
                    self.tt.delete_contents(trans_id)
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1109
            file_group = self._dump_conflicts(name, parent_id, file_id, 
1110
                                              set_version=True)
1111
            self._raw_conflicts.append(('contents conflict', file_group))
1112
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1113
        # See SPOT run.  run, SPOT, run.
1114
        # So we're not QUITE repeating ourselves; we do tricky things with
1115
        # file kind...
1116
        base_pair = contents_pair(self.base_tree)
1117
        other_pair = contents_pair(self.other_tree)
1118
        if base_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1119
            # OTHER introduced no changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1120
            return "unmodified"
1121
        this_pair = contents_pair(self.this_tree)
1122
        if this_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1123
            # THIS and OTHER introduced the same changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1124
            return "unmodified"
1125
        else:
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1126
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1127
            if this_pair == base_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1128
                # only OTHER introduced changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1129
                if file_id in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1130
                    # Remove any existing contents
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1131
                    self.tt.delete_contents(trans_id)
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
1132
                if file_id in self.other_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1133
                    # OTHER changed the file
3363.17.5 by Aaron Bentley
Update merge to not use inventory
1134
                    create_by_entry(self.tt,
1135
                                    self.other_tree.inventory[file_id],
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1136
                                    self.other_tree, trans_id)
3363.17.5 by Aaron Bentley
Update merge to not use inventory
1137
                    if file_id not in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1138
                        self.tt.version_file(file_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1139
                    return "modified"
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
1140
                elif file_id in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1141
                    # OTHER deleted the file
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1142
                    self.tt.unversion_file(trans_id)
1143
                    return "deleted"
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1144
            #BOTH THIS and OTHER introduced changes; scalar conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1145
            elif this_pair[0] == "file" and other_pair[0] == "file":
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1146
                # THIS and OTHER are both files, so text merge.  Either
1147
                # BASE is a file, or both converted to files, so at least we
1148
                # have agreement that output should be a file.
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1149
                try:
1150
                    self.text_merge(file_id, trans_id)
1151
                except BinaryFile:
1152
                    return contents_conflict()
3363.17.8 by Aaron Bentley
Get merge into a preview tree working
1153
                if file_id not in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1154
                    self.tt.version_file(file_id, trans_id)
1534.7.152 by Aaron Bentley
Fixed overwrites
1155
                try:
1156
                    self.tt.tree_kind(trans_id)
1157
                    self.tt.delete_contents(trans_id)
1158
                except NoSuchFile:
1159
                    pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1160
                return "modified"
1161
            else:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
1162
                # Scalar conflict, can't text merge.  Dump conflicts
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1163
                return contents_conflict()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1164
1165
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1166
        """Return the lines in a file, or an empty list."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1167
        if file_id in tree:
1168
            return tree.get_file(file_id).readlines()
1169
        else:
1170
            return []
1171
1172
    def text_merge(self, file_id, trans_id):
1173
        """Perform a three-way text merge on a file_id"""
1174
        # it's possible that we got here with base as a different type.
1175
        # if so, we just want two-way text conflicts.
1176
        if file_id in self.base_tree and \
1177
            self.base_tree.kind(file_id) == "file":
1178
            base_lines = self.get_lines(self.base_tree, file_id)
1179
        else:
1180
            base_lines = []
1181
        other_lines = self.get_lines(self.other_tree, file_id)
1182
        this_lines = self.get_lines(self.this_tree, file_id)
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1183
        m3 = Merge3(base_lines, this_lines, other_lines,
1184
                    is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1185
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1186
        if self.show_base is True:
1187
            base_marker = '|' * 7
1188
        else:
1189
            base_marker = None
1190
1191
        def iter_merge3(retval):
1192
            retval["text_conflicts"] = False
1193
            for line in m3.merge_lines(name_a = "TREE", 
1194
                                       name_b = "MERGE-SOURCE", 
1195
                                       name_base = "BASE-REVISION",
1196
                                       start_marker=start_marker, 
1197
                                       base_marker=base_marker,
1198
                                       reprocess=self.reprocess):
1199
                if line.startswith(start_marker):
1200
                    retval["text_conflicts"] = True
1201
                    yield line.replace(start_marker, '<' * 7)
1202
                else:
1203
                    yield line
1204
        retval = {}
1205
        merge3_iterator = iter_merge3(retval)
1206
        self.tt.create_file(merge3_iterator, trans_id)
1207
        if retval["text_conflicts"] is True:
1208
            self._raw_conflicts.append(('text conflict', trans_id))
1209
            name = self.tt.final_name(trans_id)
1210
            parent_id = self.tt.final_parent(trans_id)
1211
            file_group = self._dump_conflicts(name, parent_id, file_id, 
1212
                                              this_lines, base_lines,
1213
                                              other_lines)
1214
            file_group.append(trans_id)
1215
1216
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None, 
1217
                        base_lines=None, other_lines=None, set_version=False,
1218
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1219
        """Emit conflict files.
1220
        If this_lines, base_lines, or other_lines are omitted, they will be
1221
        determined automatically.  If set_version is true, the .OTHER, .THIS
1222
        or .BASE (in that order) will be created as versioned files.
1223
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1224
        data = [('OTHER', self.other_tree, other_lines), 
1225
                ('THIS', self.this_tree, this_lines)]
1226
        if not no_base:
1227
            data.append(('BASE', self.base_tree, base_lines))
1228
        versioned = False
1229
        file_group = []
1230
        for suffix, tree, lines in data:
1231
            if file_id in tree:
1232
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
1233
                                               suffix, lines)
1234
                file_group.append(trans_id)
1235
                if set_version and not versioned:
1236
                    self.tt.version_file(file_id, trans_id)
1237
                    versioned = True
1238
        return file_group
1239
           
1240
    def _conflict_file(self, name, parent_id, tree, file_id, suffix, 
1241
                       lines=None):
1534.7.157 by Aaron Bentley
Added more docs
1242
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1243
        name = name + '.' + suffix
1244
        trans_id = self.tt.create_path(name, parent_id)
1245
        entry = tree.inventory[file_id]
1246
        create_by_entry(self.tt, entry, tree, trans_id, lines)
1247
        return trans_id
1248
1249
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1250
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1251
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1252
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1253
        self._merge_executable(file_id, executable, file_status,
1254
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1255
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1256
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1257
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1258
        """Perform a merge on the execute bit."""
1259
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1260
        if file_status == "deleted":
1261
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1262
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1263
        if winner == "conflict":
1264
        # There must be a None in here, if we have a conflict, but we
1265
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1266
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1267
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1268
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1269
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1270
        if winner == 'this' and file_status != "modified":
1271
            return
1272
        trans_id = self.tt.trans_id_file_id(file_id)
1273
        try:
1274
            if self.tt.final_kind(trans_id) != "file":
1275
                return
1276
        except NoSuchFile:
1277
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1278
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1279
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1280
        else:
1281
            if file_id in self.other_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1282
                executability = other_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1283
            elif file_id in self.this_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1284
                executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1285
            elif file_id in self.base_tree:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1286
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1287
        if executability is not None:
1288
            trans_id = self.tt.trans_id_file_id(file_id)
1289
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1290
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1291
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1292
        """Convert all conflicts into a form that doesn't depend on trans_id"""
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1293
        from conflicts import Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1294
        name_conflicts = {}
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1295
        self.cooked_conflicts.extend(cook_conflicts(fs_conflicts, self.tt))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1296
        fp = FinalPaths(self.tt)
1297
        for conflict in self._raw_conflicts:
1298
            conflict_type = conflict[0]
1299
            if conflict_type in ('name conflict', 'parent conflict'):
1300
                trans_id = conflict[1]
1301
                conflict_args = conflict[2:]
1302
                if trans_id not in name_conflicts:
1303
                    name_conflicts[trans_id] = {}
1304
                unique_add(name_conflicts[trans_id], conflict_type, 
1305
                           conflict_args)
1306
            if conflict_type == 'contents conflict':
1307
                for trans_id in conflict[1]:
1308
                    file_id = self.tt.final_file_id(trans_id)
1309
                    if file_id is not None:
1310
                        break
1311
                path = fp.get_path(trans_id)
1312
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1313
                    if path.endswith(suffix):
1314
                        path = path[:-len(suffix)]
1315
                        break
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1316
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1317
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1318
            if conflict_type == 'text conflict':
1319
                trans_id = conflict[1]
1320
                path = fp.get_path(trans_id)
1321
                file_id = self.tt.final_file_id(trans_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1322
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
1323
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1324
1325
        for trans_id, conflicts in name_conflicts.iteritems():
1326
            try:
1327
                this_parent, other_parent = conflicts['parent conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1328
                if this_parent == other_parent:
1329
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1330
            except KeyError:
1331
                this_parent = other_parent = \
1332
                    self.tt.final_file_id(self.tt.final_parent(trans_id))
1333
            try:
1334
                this_name, other_name = conflicts['name conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1335
                if this_name == other_name:
1336
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1337
            except KeyError:
1338
                this_name = other_name = self.tt.final_name(trans_id)
1339
            other_path = fp.get_path(trans_id)
1551.16.2 by Aaron Bentley
Don't crash on merging renamed deleted files (#110279)
1340
            if this_parent is not None and this_name is not None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1341
                this_parent_path = \
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1342
                    fp.get_path(self.tt.trans_id_file_id(this_parent))
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1343
                this_path = pathjoin(this_parent_path, this_name)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1344
            else:
1345
                this_path = "<deleted>"
1346
            file_id = self.tt.final_file_id(trans_id)
1534.10.20 by Aaron Bentley
Got all tests passing
1347
            c = Conflict.factory('path conflict', path=this_path,
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1348
                                 conflict_path=other_path, file_id=file_id)
1349
            self.cooked_conflicts.append(c)
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
1350
        self.cooked_conflicts.sort(key=Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1351
1352
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1353
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1354
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1355
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1356
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1357
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1358
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1359
1360
    def _merged_lines(self, file_id):
1361
        """Generate the merged lines.
1362
        There is no distinction between lines that are meant to contain <<<<<<<
1363
        and conflicts.
1364
        """
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1365
        if self.cherrypick:
1366
            base = self.base_tree
1367
        else:
1368
            base = None
3062.2.4 by Aaron Bentley
Start supporting merge-with-base
1369
        plan = self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1370
                                              base=base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1371
        if 'merge' in debug.debug_flags:
1372
            plan = list(plan)
1373
            trans_id = self.tt.trans_id_file_id(file_id)
1374
            name = self.tt.final_name(trans_id) + '.plan'
1375
            contents = ('%10s|%s' % l for l in plan)
1376
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1551.15.52 by Aaron Bentley
Tweak from review comments
1377
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1378
            '>>>>>>> MERGE-SOURCE\n')
1379
        return textmerge.merge_lines(self.reprocess)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1380
1381
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1382
        """Perform a (weave) text merge for a given file and file-id.
1383
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1384
        and a conflict will be noted.
1385
        """
1551.6.12 by Aaron Bentley
Indicate conflicts from merge_lines, insead of guessing
1386
        lines, conflicts = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1387
        lines = list(lines)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1388
        # Note we're checking whether the OUTPUT is binary in this case, 
1389
        # because we don't want to get into weave merge guts.
1390
        check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1391
        self.tt.create_file(lines, trans_id)
1392
        if conflicts:
1393
            self._raw_conflicts.append(('text conflict', trans_id))
1394
            name = self.tt.final_name(trans_id)
1395
            parent_id = self.tt.final_parent(trans_id)
1396
            file_group = self._dump_conflicts(name, parent_id, file_id, 
1397
                                              no_base=True)
1398
            file_group.append(trans_id)
1399
1400
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1401
class LCAMerger(WeaveMerger):
1402
1403
    def _merged_lines(self, file_id):
1404
        """Generate the merged lines.
1405
        There is no distinction between lines that are meant to contain <<<<<<<
1406
        and conflicts.
1407
        """
1408
        if self.cherrypick:
1409
            base = self.base_tree
1410
        else:
1411
            base = None
1412
        plan = self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
1413
                                                  base=base)
1414
        if 'merge' in debug.debug_flags:
1415
            plan = list(plan)
1416
            trans_id = self.tt.trans_id_file_id(file_id)
1417
            name = self.tt.final_name(trans_id) + '.plan'
1418
            contents = ('%10s|%s' % l for l in plan)
1419
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
1420
        textmerge = PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1421
            '>>>>>>> MERGE-SOURCE\n')
1422
        return textmerge.merge_lines(self.reprocess)
1423
1424
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1425
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1426
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1427
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1428
    def dump_file(self, temp_dir, name, tree, file_id):
1429
        out_path = pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1430
        out_file = open(out_path, "wb")
1431
        try:
1432
            in_file = tree.get_file(file_id)
1433
            for line in in_file:
1434
                out_file.write(line)
1435
        finally:
1436
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1437
        return out_path
1438
1439
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1440
        """Perform a diff3 merge using a specified file-id and trans-id.
1441
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1442
        will be dumped, and a will be conflict noted.
1443
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1444
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1445
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1446
        try:
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
1447
            new_file = pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1448
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1449
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1450
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1451
            status = bzrlib.patch.diff3(new_file, this, base, other)
1452
            if status not in (0, 1):
1453
                raise BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1454
            f = open(new_file, 'rb')
1455
            try:
1456
                self.tt.create_file(f, trans_id)
1457
            finally:
1458
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1459
            if status == 1:
1460
                name = self.tt.final_name(trans_id)
1461
                parent_id = self.tt.final_parent(trans_id)
1462
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1463
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1464
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1465
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1466
1467
1468
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1469
                backup_files=False,
1470
                merge_type=Merge3Merger,
1471
                interesting_ids=None,
1472
                show_base=False,
1473
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1474
                other_rev_id=None,
1475
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1476
                this_tree=None,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1477
                pb=DummyProgress(),
1478
                change_reporter=None):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1479
    """Primary interface for merging. 
1480
1481
        typical use is probably 
1482
        'merge_inner(branch, branch.get_revision_tree(other_revision),
1483
                     branch.get_revision_tree(base_revision))'
1484
        """
1485
    if this_tree is None:
2367.2.1 by Robert Collins
Remove bzrlib 0.8 compatability where it was making the code unclear or messy. (Robert Collins)
1486
        raise BzrError("bzrlib.merge.merge_inner requires a this_tree "
1487
            "parameter as of bzrlib version 0.8.")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1488
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1489
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1490
    merger.backup_files = backup_files
1491
    merger.merge_type = merge_type
1492
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1493
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1494
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1495
        if interesting_ids:
1496
            raise ValueError('Only supply interesting_ids'
1497
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1498
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1499
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1500
    merger.reprocess = reprocess
1501
    merger.other_rev_id = other_rev_id
1502
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1503
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1504
    if get_revision_id is None:
1505
        get_revision_id = base_tree.last_revision
1506
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1507
    return merger.do_merge()
1508
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1509
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1510
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1511
1512
    This method provides a sanctioned way to retrieve it.
1513
    """
1514
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1515
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1516
1517
1518
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1519
    def status_a(revision, text):
1520
        if revision in ancestors_b:
1521
            return 'killed-b', text
1522
        else:
1523
            return 'new-a', text
1524
1525
    def status_b(revision, text):
1526
        if revision in ancestors_a:
1527
            return 'killed-a', text
1528
        else:
1529
            return 'new-b', text
1530
1531
    plain_a = [t for (a, t) in annotated_a]
1532
    plain_b = [t for (a, t) in annotated_b]
1533
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1534
    blocks = matcher.get_matching_blocks()
1535
    a_cur = 0
1536
    b_cur = 0
1537
    for ai, bi, l in blocks:
1538
        # process all mismatched sections
1539
        # (last mismatched section is handled because blocks always
1540
        # includes a 0-length last block)
1541
        for revision, text in annotated_a[a_cur:ai]:
1542
            yield status_a(revision, text)
1543
        for revision, text in annotated_b[b_cur:bi]:
1544
            yield status_b(revision, text)
1545
        # and now the matched section
1546
        a_cur = ai + l
1547
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
1548
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
1549
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1550
1551
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1552
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1553
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1554
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1555
        """Contructor.
1556
1557
        :param a_rev: Revision-id of one revision to merge
1558
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1559
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1560
        :param key_prefix: A prefix for accessing keys in vf, typically
1561
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1562
        """
1563
        self.a_rev = a_rev
1564
        self.b_rev = b_rev
1565
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
1566
        self._last_lines = None
1567
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
1568
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1569
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1570
        self._precache_tip_lines()
1571
1572
    def _precache_tip_lines(self):
1573
        lines = self.get_lines([self.a_rev, self.b_rev])
1574
        self.lines_a = lines[self.a_rev]
1575
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1576
1577
    def get_lines(self, revisions):
1578
        """Get lines for revisions from the backing VersionedFiles.
1579
        
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1580
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1581
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1582
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1583
        result = {}
1584
        for record in self.vf.get_record_stream(keys, 'unordered', True):
1585
            if record.storage_kind == 'absent':
1586
                raise errors.RevisionNotPresent(record.key, self.vf)
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1587
            result[record.key[-1]] = osutils.split_lines(
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1588
                record.get_bytes_as('fulltext'))
1589
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1590
1591
    def plan_merge(self):
1592
        """Generate a 'plan' for merging the two revisions.
1593
1594
        This involves comparing their texts and determining the cause of
1595
        differences.  If text A has a line and text B does not, then either the
1596
        line was added to text A, or it was deleted from B.  Once the causes
1597
        are combined, they are written out in the format described in
1598
        VersionedFile.plan_merge
1599
        """
1600
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1601
        unique_a, unique_b = self._unique_lines(blocks)
1602
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
1603
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
1604
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
1605
1606
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1607
        last_i = 0
1608
        last_j = 0
1609
        for i, j, n in blocks:
1610
            for a_index in range(last_i, i):
1611
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
1612
                    if a_index in killed_b:
1613
                        yield 'conflicted-a', self.lines_a[a_index]
1614
                    else:
1615
                        yield 'new-a', self.lines_a[a_index]
1616
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1617
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1618
            for b_index in range(last_j, j):
1619
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
1620
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
1621
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
1622
                    else:
1623
                        yield 'new-b', self.lines_b[b_index]
1624
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1625
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1626
            # handle common lines
1627
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1628
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1629
            last_i = i+n
1630
            last_j = j+n
1631
1632
    def _get_matching_blocks(self, left_revision, right_revision):
1633
        """Return a description of which sections of two revisions match.
1634
1635
        See SequenceMatcher.get_matching_blocks
1636
        """
3144.3.7 by Aaron Bentley
Update from review
1637
        cached = self._cached_matching_blocks.get((left_revision,
1638
                                                   right_revision))
1639
        if cached is not None:
1640
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
1641
        if self._last_lines_revision_id == left_revision:
1642
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1643
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1644
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1645
            lines = self.get_lines([left_revision, right_revision])
1646
            left_lines = lines[left_revision]
1647
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1648
        self._last_lines = right_lines
1649
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1650
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
1651
                                                       right_lines)
1652
        return matcher.get_matching_blocks()
1653
1654
    def _unique_lines(self, matching_blocks):
1655
        """Analyse matching_blocks to determine which lines are unique
1656
1657
        :return: a tuple of (unique_left, unique_right), where the values are
1658
            sets of line numbers of unique lines.
1659
        """
1660
        last_i = 0
1661
        last_j = 0
1662
        unique_left = []
1663
        unique_right = []
1664
        for i, j, n in matching_blocks:
1665
            unique_left.extend(range(last_i, i))
1666
            unique_right.extend(range(last_j, j))
1667
            last_i = i + n
1668
            last_j = j + n
1669
        return unique_left, unique_right
1670
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1671
    @staticmethod
1672
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
1673
        """Remove changes from new_plan that came from old_plan.
1674
1675
        It is assumed that the difference between the old_plan and new_plan
1676
        is their choice of 'b' text.
1677
1678
        All lines from new_plan that differ from old_plan are emitted
1679
        verbatim.  All lines from new_plan that match old_plan but are
1680
        not about the 'b' revision are emitted verbatim.
1681
1682
        Lines that match and are about the 'b' revision are the lines we
1683
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
1684
        is skipped entirely.
1685
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1686
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
1687
                                                       new_plan)
1688
        last_j = 0
1689
        for i, j, n in matcher.get_matching_blocks():
1690
            for jj in range(last_j, j):
1691
                yield new_plan[jj]
1692
            for jj in range(j, j+n):
1693
                plan_line = new_plan[jj]
1694
                if plan_line[0] == 'new-b':
1695
                    pass
1696
                elif plan_line[0] == 'killed-b':
1697
                    yield 'unchanged', plan_line[1]
1698
                else:
1699
                    yield plan_line
1700
            last_j = j + n
1701
1702
1703
class _PlanMerge(_PlanMergeBase):
1704
    """Plan an annotate merge using on-the-fly annotation"""
1705
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1706
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1707
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
1708
        self.a_key = self._key_prefix + (self.a_rev,)
1709
        self.b_key = self._key_prefix + (self.b_rev,)
1710
        self.graph = Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
1711
        heads = self.graph.heads((self.a_key, self.b_key))
1712
        if len(heads) == 1:
1713
            # one side dominates, so we can just return its values, yay for
1714
            # per-file graphs
1715
            # Ideally we would know that before we get this far
1716
            self._head_key = heads.pop()
1717
            if self._head_key == self.a_key:
1718
                other = b_rev
1719
            else:
1720
                other = a_rev
1721
            mutter('found dominating revision for %s\n%s > %s', self.vf,
1722
                   self._head_key[-1], other)
1723
            self._weave = None
1724
        else:
1725
            self._head_key = None
1726
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1727
1728
    def _precache_tip_lines(self):
1729
        # Turn this into a no-op, because we will do this later
1730
        pass
1731
1732
    def _find_recursive_lcas(self):
1733
        """Find all the ancestors back to a unique lca"""
1734
        cur_ancestors = (self.a_key, self.b_key)
1735
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1736
        # rather than a key tuple. We will just map that directly to no common
1737
        # ancestors.
1738
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1739
        while True:
1740
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1741
            # Map a plain NULL_REVISION to a simple no-ancestors
1742
            if next_lcas == set([NULL_REVISION]):
1743
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1744
            # Order the lca's based on when they were merged into the tip
1745
            # While the actual merge portion of weave merge uses a set() of
1746
            # active revisions, the order of insertion *does* effect the
1747
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1748
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1749
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
1750
                                                                    next_lcas))
1751
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1752
            if len(next_lcas) == 0:
1753
                break
1754
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1755
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1756
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
1757
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1758
                # More than 2 lca's, fall back to grabbing all nodes between
1759
                # this and the unique lca.
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
1760
                mutter('More than 2 LCAs, falling back to all nodes for:'
1761
                       ' %s, %s\n=> %s', self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1762
                cur_lcas = next_lcas
1763
                while len(cur_lcas) > 1:
1764
                    cur_lcas = self.graph.find_lca(*cur_lcas)
1765
                if len(cur_lcas) == 0:
1766
                    # No common base to find, use the full ancestry
1767
                    unique_lca = None
1768
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1769
                    unique_lca = list(cur_lcas)[0]
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1770
                    if unique_lca == NULL_REVISION:
1771
                        # find_lca will return a plain 'NULL_REVISION' rather
1772
                        # than a key tuple when there is no common ancestor, we
1773
                        # prefer to just use None, because it doesn't confuse
1774
                        # _get_interesting_texts()
1775
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1776
                parent_map.update(self._find_unique_parents(next_lcas,
1777
                                                            unique_lca))
1778
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1779
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1780
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1781
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1782
    def _find_unique_parents(self, tip_keys, base_key):
1783
        """Find ancestors of tip that aren't ancestors of base.
1784
        
1785
        :param tip_keys: Nodes that are interesting
1786
        :param base_key: Cull all ancestors of this node
1787
        :return: The parent map for all revisions between tip_keys and
1788
            base_key. base_key will be included. References to nodes outside of
1789
            the ancestor set will also be removed.
1790
        """
1791
        # TODO: this would be simpler if find_unique_ancestors took a list
1792
        #       instead of a single tip, internally it supports it, but it
1793
        #       isn't a "backwards compatible" api change.
1794
        if base_key is None:
1795
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1796
            # We remove NULL_REVISION because it isn't a proper tuple key, and
1797
            # thus confuses things like _get_interesting_texts, and our logic
1798
            # to add the texts into the memory weave.
1799
            if NULL_REVISION in parent_map:
1800
                parent_map.pop(NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1801
        else:
1802
            interesting = set()
1803
            for tip in tip_keys:
1804
                interesting.update(
1805
                    self.graph.find_unique_ancestors(tip, [base_key]))
1806
            parent_map = self.graph.get_parent_map(interesting)
1807
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1808
        culled_parent_map, child_map, tails = self._remove_external_references(
1809
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1810
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1811
        if base_key is not None:
1812
            tails.remove(base_key)
1813
            self._prune_tails(culled_parent_map, child_map, tails)
1814
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
1815
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
1816
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1817
1818
    @staticmethod
1819
    def _remove_external_references(parent_map):
1820
        """Remove references that go outside of the parent map.
1821
1822
        :param parent_map: Something returned from Graph.get_parent_map(keys)
1823
        :return: (filtered_parent_map, child_map, tails)
1824
            filtered_parent_map is parent_map without external references
1825
            child_map is the {parent_key: [child_keys]} mapping
1826
            tails is a list of nodes that do not have any parents in the map
1827
        """
1828
        # TODO: The basic effect of this function seems more generic than
1829
        #       _PlanMerge. But the specific details of building a child_map,
1830
        #       and computing tails seems very specific to _PlanMerge.
1831
        #       Still, should this be in Graph land?
1832
        filtered_parent_map = {}
1833
        child_map = {}
1834
        tails = []
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1835
        for key, parent_keys in parent_map.iteritems():
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1836
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
1837
            if not culled_parent_keys:
1838
                tails.append(key)
1839
            for parent_key in culled_parent_keys:
1840
                child_map.setdefault(parent_key, []).append(key)
1841
            # TODO: Do we want to do this, it adds overhead for every node,
1842
            #       just to say that the node has no children
1843
            child_map.setdefault(key, [])
1844
            filtered_parent_map[key] = culled_parent_keys
1845
        return filtered_parent_map, child_map, tails
1846
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1847
    @staticmethod
1848
    def _prune_tails(parent_map, child_map, tails_to_remove):
1849
        """Remove tails from the parent map.
1850
        
1851
        This will remove the supplied revisions until no more children have 0
1852
        parents.
1853
1854
        :param parent_map: A dict of {child: [parents]}, this dictionary will
1855
            be modified in place.
1856
        :param tails_to_remove: A list of tips that should be removed,
1857
            this list will be consumed
1858
        :param child_map: The reverse dict of parent_map ({parent: [children]})
1859
            this dict will be modified
1860
        :return: None, parent_map will be modified in place.
1861
        """
1862
        while tails_to_remove:
1863
            next = tails_to_remove.pop()
1864
            parent_map.pop(next)
1865
            children = child_map.pop(next)
1866
            for child in children:
1867
                child_parents = parent_map[child]
1868
                child_parents.remove(next)
1869
                if len(child_parents) == 0:
1870
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1871
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1872
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1873
        """Return a dict of texts we are interested in.
1874
1875
        Note that the input is in key tuples, but the output is in plain
1876
        revision ids.
1877
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1878
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1879
        :return: A dict of {'revision_id':lines} as returned by
1880
            _PlanMergeBase.get_lines()
1881
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1882
        all_revision_keys = set(parent_map)
1883
        all_revision_keys.add(self.a_key)
1884
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1885
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1886
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
1887
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1888
        return all_texts
1889
1890
    def _build_weave(self):
1891
        from bzrlib import weave
1892
        self._weave = weave.Weave(weave_name='in_memory_weave',
1893
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1894
        parent_map = self._find_recursive_lcas()
1895
1896
        all_texts = self._get_interesting_texts(parent_map)
1897
1898
        # Note: Unfortunately, the order given by topo_sort will effect the
1899
        # ordering resolution in the output. Specifically, if you add A then B,
1900
        # then in the output text A lines will show up before B lines. And, of
1901
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1902
        # So we use merge_sort, and add a fake node on the tip.
1903
        # This ensures that left-hand parents will always be inserted into the
1904
        # weave before right-hand parents.
1905
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
1906
        parent_map[tip_key] = (self.a_key, self.b_key)
1907
1908
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
1909
                                                                  tip_key)):
1910
            if key == tip_key:
1911
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1912
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1913
            parent_keys = parent_map[key]
1914
            revision_id = key[-1]
1915
            parent_ids = [k[-1] for k in parent_keys]
1916
            self._weave.add_lines(revision_id, parent_ids,
1917
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1918
1919
    def plan_merge(self):
1920
        """Generate a 'plan' for merging the two revisions.
1921
1922
        This involves comparing their texts and determining the cause of
1923
        differences.  If text A has a line and text B does not, then either the
1924
        line was added to text A, or it was deleted from B.  Once the causes
1925
        are combined, they are written out in the format described in
1926
        VersionedFile.plan_merge
1927
        """
1928
        if self._head_key is not None: # There was a single head
1929
            if self._head_key == self.a_key:
1930
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1931
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1932
                if self._head_key != self.b_key:
1933
                    raise AssertionError('There was an invalid head: %s != %s'
1934
                                         % (self.b_key, self._head_key))
1935
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
1936
            head_rev = self._head_key[-1]
1937
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1938
            return ((plan, line) for line in lines)
1939
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
1940
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1941
1942
class _PlanLCAMerge(_PlanMergeBase):
1943
    """
3144.3.7 by Aaron Bentley
Update from review
1944
    This merge algorithm differs from _PlanMerge in that:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1945
    1. comparisons are done against LCAs only
1946
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
1947
       another are marked as conflicts, by emitting the line as conflicted-a
1948
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1949
1950
    This is faster, and hopefully produces more useful output.
1951
    """
1952
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1953
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
1954
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
1955
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
1956
        self.lcas = set()
1957
        for lca in lcas:
1958
            if lca == NULL_REVISION:
1959
                self.lcas.add(lca)
1960
            else:
1961
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
1962
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
1963
            if _mod_revision.is_null(lca):
1964
                lca_lines = []
1965
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
1966
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
1967
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
1968
                                                           lca_lines)
1969
            blocks = list(matcher.get_matching_blocks())
1970
            self._cached_matching_blocks[(a_rev, lca)] = blocks
1971
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
1972
                                                           lca_lines)
1973
            blocks = list(matcher.get_matching_blocks())
1974
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1975
3144.3.7 by Aaron Bentley
Update from review
1976
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1977
        """Determines the status unique lines versus all lcas.
1978
1979
        Basically, determines why the line is unique to this revision.
1980
1981
        A line may be determined new, killed, or both.
1982
3144.3.7 by Aaron Bentley
Update from review
1983
        If a line is determined new, that means it was not present in at least
1984
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1985
1986
        If a line is determined killed, that means the line was present in
1987
        at least one LCA.
1988
1989
        If a line is killed and new, this indicates that the two merge
1990
        revisions contain differing conflict resolutions.
3144.3.7 by Aaron Bentley
Update from review
1991
        :param revision_id: The id of the revision in which the lines are
1992
            unique
1993
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1994
        :return a tuple of (new_this, killed_other):
1995
        """
1996
        new = set()
1997
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
1998
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1999
        for lca in self.lcas:
2000
            blocks = self._get_matching_blocks(revision_id, lca)
2001
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2002
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2003
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2004
        return new, killed