/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1
# Copyright (C) 2005, 2006, 2008 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
17
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
18
from bzrlib import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
19
    branch as _mod_branch,
20
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
21
    debug,
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
22
    decorators,
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
23
    errors,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
24
    graph as _mod_graph,
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
25
    hooks,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
26
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
27
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
28
    patiencediff,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
29
    progress,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
30
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
31
    textfile,
32
    trace,
33
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
34
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
35
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
36
    ui,
37
    versionedfile
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
38
    )
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
39
from bzrlib.symbol_versioning import (
40
    deprecated_in,
41
    deprecated_method,
42
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
43
# TODO: Report back as changes are merged in
44
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
45
1185.35.4 by Aaron Bentley
Implemented remerge
46
def transform_tree(from_tree, to_tree, interesting_ids=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
47
    from_tree.lock_tree_write()
48
    try:
49
        merge_inner(from_tree.branch, to_tree, from_tree, ignore_zero=True,
50
                    interesting_ids=interesting_ids, this_tree=from_tree)
51
    finally:
52
        from_tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
53
1457.1.12 by Robert Collins
Update comment to reflect author.
54
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
55
class MergeHooks(hooks.Hooks):
56
57
    def __init__(self):
58
        hooks.Hooks.__init__(self)
59
        self.create_hook(hooks.HookPoint('merge_file_content',
4869.3.9 by Andrew Bennetts
Document hook point better
60
            "Called when file content needs to be merged (including when one "
61
            "side has deleted the file and the other has changed it)."
62
            "merge_file_content is called with a "
4869.3.11 by Andrew Bennetts
More docs.
63
            "bzrlib.merge.MergeHookParams. The function should return a tuple "
64
            "of (status, lines), where status is one of 'not_applicable', "
65
            "'success', 'conflicted', or 'delete'.  If status is success or "
4869.3.30 by Andrew Bennetts
Clarify hook docstring; hooks can return a iterable of strings, rather than lines.
66
            "conflicted, then lines should be an iterable of strings of the "
4869.3.31 by Andrew Bennetts
Add comment, improve doc string, remove redundant line.
67
            "new file contents.",
4869.3.9 by Andrew Bennetts
Document hook point better
68
            (2, 1), None))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
69
70
71
class MergeHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
72
    """Object holding parameters passed to merge_file_content hooks.
73
74
    There are 3 fields hooks can access:
75
76
    :ivar merger: the Merger object
77
    :ivar file_id: the file ID of the file being merged
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
78
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
79
    :ivar this_kind: kind of file_id in 'this' tree
80
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
81
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
82
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
83
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
84
    def __init__(self, merger, file_id, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
85
            winner):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
86
        self.merger = merger
87
        self.file_id = file_id
88
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
89
        self.this_kind = this_kind
90
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
91
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
92
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
93
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
94
        """True if this_kind and other_kind are both 'file'."""
95
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
96
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
97
    @decorators.cachedproperty
98
    def base_lines(self):
99
        """The lines of the 'base' version of the file."""
100
        return self.merger.get_lines(self.merger.base_tree, self.file_id)
101
102
    @decorators.cachedproperty
103
    def this_lines(self):
104
        """The lines of the 'this' version of the file."""
105
        return self.merger.get_lines(self.merger.this_tree, self.file_id)
106
107
    @decorators.cachedproperty
108
    def other_lines(self):
109
        """The lines of the 'other' version of the file."""
110
        return self.merger.get_lines(self.merger.other_tree, self.file_id)
111
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
112
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
113
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
114
115
    hooks = MergeHooks()
116
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
117
    def __init__(self, this_branch, other_tree=None, base_tree=None,
1551.21.8 by Aaron Bentley
Remove now-redundant DummyProgress from Merger.__init__
118
                 this_tree=None, pb=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
119
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
120
        object.__init__(self)
121
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
122
        self.this_basis = _mod_revision.ensure_null(
123
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
124
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
125
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
126
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
127
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
128
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
129
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
130
        self.base_tree = base_tree
131
        self.ignore_zero = False
132
        self.backup_files = False
133
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
134
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
135
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
136
        self.reprocess = False
1551.21.7 by Aaron Bentley
Fix progress warning
137
        if pb is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
138
            pb = progress.DummyProgress()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
139
        self._pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
140
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
141
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
142
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
143
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
144
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
145
        self._base_is_ancestor = None
146
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
147
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
148
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
149
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
150
    def cache_trees_with_revision_ids(self, trees):
151
        """Cache any tree in trees if it has a revision_id."""
152
        for maybe_tree in trees:
153
            if maybe_tree is None:
154
                continue
155
            try:
156
                rev_id = maybe_tree.get_revision_id()
157
            except AttributeError:
158
                continue
159
            self._cached_trees[rev_id] = maybe_tree
160
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
161
    @property
162
    def revision_graph(self):
163
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
164
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
165
        return self._revision_graph
166
167
    def _set_base_is_ancestor(self, value):
168
        self._base_is_ancestor = value
169
170
    def _get_base_is_ancestor(self):
171
        if self._base_is_ancestor is None:
172
            self._base_is_ancestor = self.revision_graph.is_ancestor(
173
                self.base_rev_id, self.this_basis)
174
        return self._base_is_ancestor
175
176
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
177
178
    def _set_base_is_other_ancestor(self, value):
179
        self._base_is_other_ancestor = value
180
181
    def _get_base_is_other_ancestor(self):
182
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
183
            if self.other_basis is None:
184
                return True
185
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
186
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
187
        return self._base_is_other_ancestor
188
189
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
190
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
191
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
192
    @staticmethod
1551.21.7 by Aaron Bentley
Fix progress warning
193
    def from_uncommitted(tree, other_tree, pb=None, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
194
        """Return a Merger for uncommitted changes in other_tree.
195
196
        :param tree: The tree to merge into
197
        :param other_tree: The tree to get uncommitted changes from
198
        :param pb: A progress indicator
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
199
        :param base_tree: The basis to use for the merge.  If unspecified,
200
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
201
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
202
        if base_tree is None:
203
            base_tree = other_tree.basis_tree()
204
        merger = Merger(tree.branch, other_tree, base_tree, tree, pb)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
205
        merger.base_rev_id = merger.base_tree.get_revision_id()
206
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
207
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
208
        return merger
209
210
    @classmethod
211
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
212
        """Return a Merger for a bundle or merge directive.
213
214
        :param tree: The tree to merge changes into
215
        :param mergeable: A merge directive or bundle
216
        :param pb: A progress indicator
217
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
218
        mergeable.install_revisions(tree.branch.repository)
219
        base_revision_id, other_revision_id, verified =\
220
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
221
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
222
        if base_revision_id is not None:
223
            if (base_revision_id != _mod_revision.NULL_REVISION and
224
                revision_graph.is_ancestor(
225
                base_revision_id, tree.branch.last_revision())):
226
                base_revision_id = None
227
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
228
                trace.warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
229
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
230
                                         base_revision_id, revision_graph=
231
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
232
        return merger, verified
233
234
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
235
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
236
                          base_branch=None, revision_graph=None,
237
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
238
        """Return a Merger for revision-ids.
239
3363.17.15 by Aaron Bentley
Update docs
240
        :param pb: A progress indicator
1551.15.74 by Aaron Bentley
Textual updates from review
241
        :param tree: The tree to merge changes into
242
        :param other: The revision-id to use as OTHER
243
        :param base: The revision-id to use as BASE.  If not specified, will
244
            be auto-selected.
245
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
246
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
247
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
248
            not supplied, other_branch or tree.branch will be used.
249
        :param revision_graph: If you have a revision_graph precomputed, pass
250
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
251
        :param tree_branch: The branch associated with tree.  If not supplied,
252
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
253
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
254
        if tree_branch is None:
255
            tree_branch = tree.branch
256
        merger = Merger(tree_branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
257
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
258
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
259
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
260
        merger.set_other_revision(other, other_branch)
261
        if base is None:
262
            merger.find_base()
263
        else:
264
            if base_branch is None:
265
                base_branch = other_branch
266
            merger.set_base_revision(base, base_branch)
267
        return merger
268
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
269
    def revision_tree(self, revision_id, branch=None):
270
        if revision_id not in self._cached_trees:
271
            if branch is None:
272
                branch = self.this_branch
273
            try:
274
                tree = self.this_tree.revision_tree(revision_id)
275
            except errors.NoSuchRevisionInTree:
276
                tree = branch.repository.revision_tree(revision_id)
277
            self._cached_trees[revision_id] = tree
278
        return self._cached_trees[revision_id]
279
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
280
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
281
        from bzrlib import workingtree
282
        location, revno = treespec
283
        if revno is None:
284
            tree = workingtree.WorkingTree.open_containing(location)[0]
285
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
286
        branch = _mod_branch.Branch.open_containing(
287
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
288
        if revno == -1:
289
            revision_id = branch.last_revision()
290
        else:
291
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
292
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
293
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
294
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
295
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
296
    def ensure_revision_trees(self):
297
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
298
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
299
            if self.this_basis == self.this_rev_id:
300
                self.this_revision_tree = self.this_basis_tree
301
1185.12.83 by Aaron Bentley
Preliminary weave merge support
302
        if self.other_rev_id is None:
303
            other_basis_tree = self.revision_tree(self.other_basis)
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
304
            if other_basis_tree.has_changes(self.other_tree):
4869.2.1 by Andrew Bennetts
Trivial improvements to bzrlib/merge.py suggested by pyflakes.
305
                raise errors.WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
306
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
307
            self.other_tree = other_basis_tree
308
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
309
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
310
    def file_revisions(self, file_id):
311
        self.ensure_revision_trees()
312
        def get_id(tree, file_id):
313
            revision_id = tree.inventory[file_id].revision
314
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
315
        if self.this_rev_id is None:
316
            if self.this_basis_tree.get_file_sha1(file_id) != \
317
                self.this_tree.get_file_sha1(file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
318
                raise errors.WorkingTreeNotRevision(self.this_tree)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
319
320
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
321
        return [get_id(tree, file_id) for tree in trees]
322
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
323
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
324
    def check_basis(self, check_clean, require_commits=True):
325
        if self.this_basis is None and require_commits is True:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
326
            raise errors.BzrCommandError(
327
                "This branch has no commits."
328
                " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
329
        if check_clean:
330
            self.compare_basis()
331
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
332
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
333
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
334
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
335
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
336
        try:
337
            basis_tree = self.revision_tree(self.this_tree.last_revision())
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
338
        except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
339
            basis_tree = self.this_tree.basis_tree()
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
340
        if not self.this_tree.has_changes(basis_tree):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
341
            self.this_rev_id = self.this_basis
342
343
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
344
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
345
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
346
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
347
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
348
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
349
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
350
        self._add_parent()
351
352
    def _add_parent(self):
353
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
354
        new_parent_trees = []
355
        for revision_id in new_parents:
356
            try:
357
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
358
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
359
                tree = None
360
            else:
361
                tree.lock_read()
362
            new_parent_trees.append((revision_id, tree))
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
363
        try:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
364
            self.this_tree.set_parent_trees(new_parent_trees,
365
                                            allow_leftmost_as_ghost=True)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
366
        finally:
367
            for _revision_id, tree in new_parent_trees:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
368
                if tree is not None:
369
                    tree.unlock()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
370
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
371
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
372
        """Set the revision and tree to merge from.
373
374
        This sets the other_tree, other_rev_id, other_basis attributes.
375
376
        :param other_revision: The [path, revision] list to merge from.
377
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
378
        self.other_branch, self.other_tree = self._get_tree(other_revision,
379
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
380
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
381
            self.other_rev_id = _mod_revision.ensure_null(
382
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
383
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
384
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
385
            self.other_basis = self.other_rev_id
386
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
387
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
388
            self.other_basis = self.other_rev_id
389
        else:
390
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
391
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
392
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
393
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
394
        if self.other_rev_id is not None:
395
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
396
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
397
2100.3.29 by Aaron Bentley
Get merge working initially
398
    def set_other_revision(self, revision_id, other_branch):
399
        """Set 'other' based on a branch and revision id
400
401
        :param revision_id: The revision to use for a tree
402
        :param other_branch: The branch containing this tree
403
        """
404
        self.other_rev_id = revision_id
405
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
406
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
407
        self.other_tree = self.revision_tree(revision_id)
408
        self.other_basis = revision_id
409
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
410
    def set_base_revision(self, revision_id, branch):
411
        """Set 'base' based on a branch and revision id
412
413
        :param revision_id: The revision to use for a tree
414
        :param branch: The branch containing this tree
415
        """
416
        self.base_rev_id = revision_id
417
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
418
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
419
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
420
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
421
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
422
        if not source.repository.has_same_location(target.repository):
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
423
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
424
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
425
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
426
        revisions = [_mod_revision.ensure_null(self.this_basis),
427
                     _mod_revision.ensure_null(self.other_basis)]
428
        if _mod_revision.NULL_REVISION in revisions:
429
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
430
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
431
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
432
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
433
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
434
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
435
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
436
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
437
            elif len(lcas) == 1:
438
                self.base_rev_id = list(lcas)[0]
439
            else: # len(lcas) > 1
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
440
                if len(lcas) > 2:
441
                    # find_unique_lca can only handle 2 nodes, so we have to
442
                    # start back at the beginning. It is a shame to traverse
443
                    # the graph again, but better than re-implementing
444
                    # find_unique_lca.
445
                    self.base_rev_id = self.revision_graph.find_unique_lca(
446
                                            revisions[0], revisions[1])
447
                else:
448
                    self.base_rev_id = self.revision_graph.find_unique_lca(
449
                                            *lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
450
                self._is_criss_cross = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
451
            if self.base_rev_id == _mod_revision.NULL_REVISION:
452
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
453
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
454
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
455
                              ' help criss-cross.')
456
                trace.mutter('Criss-cross lcas: %r' % lcas)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
457
                interesting_revision_ids = [self.base_rev_id]
458
                interesting_revision_ids.extend(lcas)
459
                interesting_trees = dict((t.get_revision_id(), t)
460
                    for t in self.this_branch.repository.revision_trees(
461
                        interesting_revision_ids))
462
                self._cached_trees.update(interesting_trees)
463
                self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
464
                sorted_lca_keys = self.revision_graph.find_merge_order(
465
                    revisions[0], lcas)
466
                self._lca_trees = [interesting_trees[key]
467
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
468
            else:
469
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
470
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
471
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
472
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
473
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
474
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
475
        """Set the base revision to use for the merge.
476
477
        :param base_revision: A 2-list containing a path and revision number.
478
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
479
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
480
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
481
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
482
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
483
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
484
            if base_revision[1] == -1:
485
                self.base_rev_id = base_branch.last_revision()
486
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
487
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
488
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
489
                self.base_rev_id = _mod_revision.ensure_null(
490
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
491
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
492
3008.1.8 by Michael Hudson
extract merger creation into a method
493
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
494
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
495
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
496
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
497
                  'interesting_files': self.interesting_files,
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
498
                  'pp': self.pp, 'this_branch': self.this_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
499
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
500
        if self.merge_type.requires_base:
501
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
502
        if self.merge_type.supports_reprocess:
503
            kwargs['reprocess'] = self.reprocess
504
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
505
            raise errors.BzrError(
506
                "Conflict reduction is not supported for merge"
507
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
508
        if self.merge_type.supports_show_base:
509
            kwargs['show_base'] = self.show_base
510
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
511
            raise errors.BzrError("Showing base is not supported for this"
512
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
513
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
514
            and not self.base_is_other_ancestor):
515
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
516
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
517
            kwargs['cherrypick'] = (not self.base_is_ancestor or
518
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
519
        if self._is_criss_cross and getattr(self.merge_type,
520
                                            'supports_lca_trees', False):
521
            kwargs['lca_trees'] = self._lca_trees
3008.1.8 by Michael Hudson
extract merger creation into a method
522
        return self.merge_type(pb=self._pb,
523
                               change_reporter=self.change_reporter,
524
                               **kwargs)
525
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
526
    def _do_merge_to(self, merge):
4273.1.9 by Aaron Bentley
Cleanup
527
        if self.other_branch is not None:
528
            self.other_branch.update_references(self.this_branch)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
529
        merge.do_merge()
530
        if self.recurse == 'down':
531
            for relpath, file_id in self.this_tree.iter_references():
532
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
533
                other_revision = self.other_tree.get_reference_revision(
534
                    file_id, relpath)
535
                if  other_revision == sub_tree.last_revision():
536
                    continue
537
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
538
                sub_merge.merge_type = self.merge_type
539
                other_branch = self.other_branch.reference_parent(file_id, relpath)
540
                sub_merge.set_other_revision(other_revision, other_branch)
541
                base_revision = self.base_tree.get_reference_revision(file_id)
542
                sub_merge.base_tree = \
543
                    sub_tree.branch.repository.revision_tree(base_revision)
544
                sub_merge.base_rev_id = base_revision
545
                sub_merge.do_merge()
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
546
3008.1.8 by Michael Hudson
extract merger creation into a method
547
    def do_merge(self):
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
548
        self.this_tree.lock_tree_write()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
549
        try:
550
            if self.base_tree is not None:
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
551
                self.base_tree.lock_read()
552
            try:
553
                if self.other_tree is not None:
554
                    self.other_tree.lock_read()
555
                try:
556
                    merge = self.make_merger()
557
                    self._do_merge_to(merge)
558
                finally:
559
                    if self.other_tree is not None:
560
                        self.other_tree.unlock()
561
            finally:
562
                if self.base_tree is not None:
563
                    self.base_tree.unlock()
564
        finally:
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
565
            self.this_tree.unlock()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
566
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
567
            if not self.ignore_zero and not trace.is_quiet():
568
                trace.note("All changes applied successfully.")
1534.7.141 by Aaron Bentley
Added conflict reporting
569
        else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
570
            trace.note("%d conflicts encountered."
571
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
572
1534.7.134 by Aaron Bentley
Hid raw conflicts
573
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
574
1545.2.4 by Aaron Bentley
PEP8 fixes
575
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
576
class _InventoryNoneEntry(object):
577
    """This represents an inventory entry which *isn't there*.
578
579
    It simplifies the merging logic if we always have an InventoryEntry, even
580
    if it isn't actually present
581
    """
582
    executable = None
583
    kind = None
584
    name = None
585
    parent_id = None
586
    revision = None
587
    symlink_target = None
588
    text_sha1 = None
589
590
_none_entry = _InventoryNoneEntry()
591
592
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
593
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
594
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
595
    requires_base = True
596
    supports_reprocess = True
597
    supports_show_base = True
598
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
599
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
600
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
601
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
602
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
603
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
604
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
605
                 interesting_ids=None, reprocess=False, show_base=False,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
606
                 pb=progress.DummyProgress(), pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
607
                 interesting_files=None, do_merge=True,
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
608
                 cherrypick=False, lca_trees=None, this_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
609
        """Initialize the merger object and perform the merge.
610
611
        :param working_tree: The working tree to apply the merge to
612
        :param this_tree: The local tree in the merge operation
613
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
614
        :param other_tree: The other tree to merge changes from
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
615
        :param this_branch: The branch associated with this_tree
2590.2.10 by Aaron Bentley
Updates from review
616
        :param interesting_ids: The file_ids of files that should be
617
            participate in the merge.  May not be combined with
618
            interesting_files.
619
        :param: reprocess If True, perform conflict-reduction processing.
620
        :param show_base: If True, show the base revision in text conflicts.
621
            (incompatible with reprocess)
622
        :param pb: A Progress bar
623
        :param pp: A ProgressPhase object
624
        :param change_reporter: An object that should report changes made
625
        :param interesting_files: The tree-relative paths of files that should
626
            participate in the merge.  If these paths refer to directories,
627
            the contents of those directories will also be included.  May not
628
            be combined with interesting_ids.  If neither interesting_files nor
629
            interesting_ids is specified, all files may participate in the
630
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
631
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
632
            if the ancestry was found to include a criss-cross merge.
633
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
634
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
635
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
636
        if interesting_files is not None and interesting_ids is not None:
637
            raise ValueError(
638
                'specify either interesting_ids or interesting_files')
2590.2.4 by Aaron Bentley
Move entry generation to a helper
639
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
640
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
641
        self.this_tree = working_tree
642
        self.base_tree = base_tree
643
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
644
        self.this_branch = this_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
645
        self._raw_conflicts = []
646
        self.cooked_conflicts = []
647
        self.reprocess = reprocess
648
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
649
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
650
        # Uncommenting this will change the default algorithm to always use
651
        # _entries_lca. This can be useful for running the test suite and
652
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
653
        # if lca_trees is None:
654
        #     self._lca_trees = [self.base_tree]
1534.9.1 by Aaron Bentley
Added progress bars to merge
655
        self.pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
656
        self.pp = pp
1551.11.9 by Aaron Bentley
Apply change reporting to merge
657
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
658
        self.cherrypick = cherrypick
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
659
        if self.pp is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
660
            self.pp = progress.ProgressPhase("Merge phase", 3, self.pb)
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
661
        if do_merge:
662
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
663
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
664
    def do_merge(self):
665
        self.this_tree.lock_tree_write()
666
        self.base_tree.lock_read()
667
        self.other_tree.lock_read()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
668
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
669
            self.tt = transform.TreeTransform(self.this_tree, self.pb)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
670
            try:
4684.1.2 by Gary van der Merwe
In merger, make sure that we unlock the trees if we fail to create a TreeTransform object.
671
                self.pp.next_phase()
672
                self._compute_transform()
673
                self.pp.next_phase()
674
                results = self.tt.apply(no_conflicts=True)
675
                self.write_modified(results)
676
                try:
677
                    self.this_tree.add_conflicts(self.cooked_conflicts)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
678
                except errors.UnsupportedOperation:
4684.1.2 by Gary van der Merwe
In merger, make sure that we unlock the trees if we fail to create a TreeTransform object.
679
                    pass
680
            finally:
681
                self.tt.finalize()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
682
        finally:
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
683
            self.other_tree.unlock()
684
            self.base_tree.unlock()
685
            self.this_tree.unlock()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
686
            self.pb.clear()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
687
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
688
    def make_preview_transform(self):
689
        self.base_tree.lock_read()
690
        self.other_tree.lock_read()
4721.3.1 by Vincent Ladeuil
Cleanup imports.
691
        self.tt = transform.TransformPreview(self.this_tree)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
692
        try:
693
            self.pp.next_phase()
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
694
            self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
695
            self.pp.next_phase()
696
        finally:
697
            self.other_tree.unlock()
698
            self.base_tree.unlock()
699
            self.pb.clear()
700
        return self.tt
701
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
702
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
703
        if self._lca_trees is None:
704
            entries = self._entries3()
705
            resolver = self._three_way
706
        else:
707
            entries = self._entries_lca()
708
            resolver = self._lca_multi_way
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
709
        child_pb = ui.ui_factory.nested_progress_bar()
710
        try:
711
            for num, (file_id, changed, parents3, names3,
712
                      executable3) in enumerate(entries):
713
                child_pb.update('Preparing file merge', num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
714
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
715
                if changed:
716
                    file_status = self.merge_contents(file_id)
717
                else:
718
                    file_status = 'unmodified'
719
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
720
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
721
        finally:
722
            child_pb.finished()
723
        self.fix_root()
724
        self.pp.next_phase()
725
        child_pb = ui.ui_factory.nested_progress_bar()
726
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
727
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
728
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
729
        finally:
730
            child_pb.finished()
731
        if self.change_reporter is not None:
732
            from bzrlib import delta
733
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
734
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
735
        self.cook_conflicts(fs_conflicts)
736
        for conflict in self.cooked_conflicts:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
737
            trace.warning(conflict)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
738
2590.2.4 by Aaron Bentley
Move entry generation to a helper
739
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
740
        """Gather data about files modified between three trees.
741
742
        Return a list of tuples of file_id, changed, parents3, names3,
743
        executable3.  changed is a boolean indicating whether the file contents
744
        or kind were changed.  parents3 is a tuple of parent ids for base,
745
        other and this.  names3 is a tuple of names for base, other and this.
746
        executable3 is a tuple of execute-bit values for base, other and this.
747
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
748
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
749
        iterator = self.other_tree.iter_changes(self.base_tree,
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
750
                include_unchanged=True, specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
751
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
752
        this_entries = dict((e.file_id, e) for p, e in
753
                            self.this_tree.iter_entries_by_dir(
754
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
755
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
756
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
757
            if (self.interesting_ids is not None and
758
                file_id not in self.interesting_ids):
759
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
760
            entry = this_entries.get(file_id)
761
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
762
                this_name = entry.name
763
                this_parent = entry.parent_id
764
                this_executable = entry.executable
765
            else:
766
                this_name = None
767
                this_parent = None
768
                this_executable = None
769
            parents3 = parents + (this_parent,)
770
            names3 = names + (this_name,)
771
            executable3 = executable + (this_executable,)
772
            result.append((file_id, changed, parents3, names3, executable3))
773
        return result
774
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
775
    def _entries_lca(self):
776
        """Gather data about files modified between multiple trees.
777
778
        This compares OTHER versus all LCA trees, and for interesting entries,
779
        it then compares with THIS and BASE.
780
781
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
782
        :return: [(file_id, changed, parents, names, executable)]
783
            file_id     Simple file_id of the entry
784
            changed     Boolean, True if the kind or contents changed
785
                        else False
786
            parents     ((base, [parent_id, in, lcas]), parent_id_other,
787
                         parent_id_this)
788
            names       ((base, [name, in, lcas]), name_in_other, name_in_this)
789
            executable  ((base, [exec, in, lcas]), exec_in_other, exec_in_this)
790
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
791
        if self.interesting_files is not None:
792
            lookup_trees = [self.this_tree, self.base_tree]
793
            lookup_trees.extend(self._lca_trees)
794
            # I think we should include the lca trees as well
795
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
796
                                                        lookup_trees)
797
        else:
798
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
799
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
800
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
801
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
802
        base_inventory = self.base_tree.inventory
803
        this_inventory = self.this_tree.inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
804
        for path, file_id, other_ie, lca_values in walker.iter_all():
805
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
806
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
807
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
808
            if interesting_ids is not None and file_id not in interesting_ids:
809
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
810
3514.4.30 by John Arbash Meinel
Several updates.
811
            # If other_revision is found in any of the lcas, that means this
812
            # node is uninteresting. This is because when merging, if there are
813
            # multiple heads(), we have to create a new node. So if we didn't,
814
            # we know that the ancestry is linear, and that OTHER did not
815
            # modify anything
816
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
817
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
818
            if other_revision is not None:
819
                # We can't use this shortcut when other_revision is None,
820
                # because it may be None because things are WorkingTrees, and
821
                # not because it is *actually* None.
822
                is_unmodified = False
823
                for lca_path, ie in lca_values:
824
                    if ie is not None and ie.revision == other_revision:
825
                        is_unmodified = True
826
                        break
827
                if is_unmodified:
828
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
829
830
            lca_entries = []
831
            for lca_path, lca_ie in lca_values:
832
                if lca_ie is None:
833
                    lca_entries.append(_none_entry)
834
                else:
835
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
836
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
837
            if file_id in base_inventory:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
838
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
839
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
840
                base_ie = _none_entry
841
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
842
            if file_id in this_inventory:
843
                this_ie = this_inventory[file_id]
844
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
845
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
846
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
847
            lca_kinds = []
848
            lca_parent_ids = []
849
            lca_names = []
850
            lca_executable = []
851
            for lca_ie in lca_entries:
852
                lca_kinds.append(lca_ie.kind)
853
                lca_parent_ids.append(lca_ie.parent_id)
854
                lca_names.append(lca_ie.name)
855
                lca_executable.append(lca_ie.executable)
856
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
857
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
858
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
859
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
860
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
861
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
862
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
863
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
864
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
865
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
866
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
867
            content_changed = True
868
            if kind_winner == 'this':
869
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
870
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
871
                    if parent_id_winner == 'this' and name_winner == 'this':
872
                        # No change for this directory in OTHER, skip
873
                        continue
874
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
875
                elif other_ie.kind is None or other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
876
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
877
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
878
                            return None
879
                        return tree.get_file_sha1(file_id)
880
                    base_sha1 = get_sha1(base_ie, self.base_tree)
881
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
882
                                 in zip(lca_entries, self._lca_trees)]
883
                    this_sha1 = get_sha1(this_ie, self.this_tree)
884
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
885
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
886
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
887
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
888
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
889
                        (base_ie.executable, lca_executable),
890
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
891
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
892
                        and sha1_winner == 'this' and exec_winner == 'this'):
893
                        # No kind, parent, name, exec, or content change for
894
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
895
                        continue
896
                    if sha1_winner == 'this':
897
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
898
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
899
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
900
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
901
                            return None
902
                        return tree.get_symlink_target(file_id)
903
                    base_target = get_target(base_ie, self.base_tree)
904
                    lca_targets = [get_target(ie, tree) for ie, tree
905
                                   in zip(lca_entries, self._lca_trees)]
906
                    this_target = get_target(this_ie, self.this_tree)
907
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
908
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
909
                        (base_target, lca_targets),
910
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
911
                    if (parent_id_winner == 'this' and name_winner == 'this'
912
                        and target_winner == 'this'):
913
                        # No kind, parent, name, or symlink target change
914
                        # not interesting
915
                        continue
916
                    if target_winner == 'this':
917
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
918
                elif other_ie.kind == 'tree-reference':
919
                    # The 'changed' information seems to be handled at a higher
920
                    # level. At least, _entries3 returns False for content
921
                    # changed, even when at a new revision_id.
922
                    content_changed = False
923
                    if (parent_id_winner == 'this' and name_winner == 'this'):
924
                        # Nothing interesting
925
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
926
                else:
927
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
928
                # XXX: We need to handle kind == 'symlink'
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
929
930
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
931
            result.append((file_id, content_changed,
932
                           ((base_ie.parent_id, lca_parent_ids),
933
                            other_ie.parent_id, this_ie.parent_id),
934
                           ((base_ie.name, lca_names),
935
                            other_ie.name, this_ie.name),
936
                           ((base_ie.executable, lca_executable),
937
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
938
                          ))
939
        return result
940
941
1731.1.33 by Aaron Bentley
Revert no-special-root changes
942
    def fix_root(self):
943
        try:
944
            self.tt.final_kind(self.tt.root)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
945
        except errors.NoSuchFile:
1731.1.33 by Aaron Bentley
Revert no-special-root changes
946
            self.tt.cancel_deletion(self.tt.root)
947
        if self.tt.final_file_id(self.tt.root) is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
948
            self.tt.version_file(self.tt.tree_file_id(self.tt.root),
1731.1.33 by Aaron Bentley
Revert no-special-root changes
949
                                 self.tt.root)
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
950
        other_root_file_id = self.other_tree.get_root_id()
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
951
        if other_root_file_id is None:
952
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
953
        other_root = self.tt.trans_id_file_id(other_root_file_id)
954
        if other_root == self.tt.root:
955
            return
956
        try:
957
            self.tt.final_kind(other_root)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
958
        except errors.NoSuchFile:
1731.1.33 by Aaron Bentley
Revert no-special-root changes
959
            return
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
960
        if self.this_tree.has_id(self.other_tree.inventory.root.file_id):
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
961
            # the other tree's root is a non-root in the current tree
962
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
963
        self.reparent_children(self.other_tree.inventory.root, self.tt.root)
964
        self.tt.cancel_creation(other_root)
965
        self.tt.cancel_versioning(other_root)
966
967
    def reparent_children(self, ie, target):
968
        for thing, child in ie.children.iteritems():
969
            trans_id = self.tt.trans_id_file_id(child.file_id)
970
            self.tt.adjust_path(self.tt.final_name(trans_id), target, trans_id)
971
1534.7.192 by Aaron Bentley
Record hashes produced by merges
972
    def write_modified(self, results):
973
        modified_hashes = {}
974
        for path in results.modified_paths:
975
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
976
            if file_id is None:
977
                continue
978
            hash = self.this_tree.get_file_sha1(file_id)
979
            if hash is None:
980
                continue
981
            modified_hashes[file_id] = hash
982
        self.this_tree.set_merge_modified(modified_hashes)
983
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
984
    @staticmethod
985
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
986
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
987
        if entry is None:
988
            return None
989
        return entry.parent_id
990
991
    @staticmethod
992
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
993
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
994
        if entry is None:
995
            return None
996
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
997
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
998
    @staticmethod
999
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1000
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1001
        if file_id not in tree:
1002
            return None
1003
        return tree.get_file_sha1(file_id)
1004
1005
    @staticmethod
1006
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1007
        """Determine the executability of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1008
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1009
            return None
1010
        if tree.kind(file_id) != "file":
1011
            return False
1012
        return tree.is_executable(file_id)
1013
1014
    @staticmethod
1015
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1016
        """Determine the kind of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1017
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1018
            return None
1019
        return tree.kind(file_id)
1020
1021
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1022
    def _three_way(base, other, this):
1023
        #if base == other, either they all agree, or only THIS has changed.
1024
        if base == other:
1025
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1026
        elif this not in (base, other):
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1027
            return 'conflict'
2590.2.10 by Aaron Bentley
Updates from review
1028
        # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1029
        elif this == other:
1030
            return "this"
2590.2.10 by Aaron Bentley
Updates from review
1031
        # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1032
        else:
1033
            return "other"
1034
1035
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1036
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1037
        """Consider LCAs when determining whether a change has occurred.
1038
1039
        If LCAS are all identical, this is the same as a _three_way comparison.
1040
1041
        :param bases: value in (BASE, [LCAS])
1042
        :param other: value in OTHER
1043
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1044
        :param allow_overriding_lca: If there is more than one unique lca
1045
            value, allow OTHER to override THIS if it has a new value, and
1046
            THIS only has an lca value, or vice versa. This is appropriate for
1047
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1048
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1049
            changed or not.
1050
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1051
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1052
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1053
        if other == this:
1054
            # Either Ambiguously clean, or nothing was actually changed. We
1055
            # don't really care
1056
            return 'this'
1057
        base_val, lca_vals = bases
1058
        # Remove 'base_val' from the lca_vals, because it is not interesting
1059
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1060
                                      if lca_val != base_val]
1061
        if len(filtered_lca_vals) == 0:
1062
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1063
1064
        unique_lca_vals = set(filtered_lca_vals)
1065
        if len(unique_lca_vals) == 1:
1066
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1067
1068
        if allow_overriding_lca:
1069
            if other in unique_lca_vals:
1070
                if this in unique_lca_vals:
1071
                    # Each side picked a different lca, conflict
1072
                    return 'conflict'
1073
                else:
1074
                    # This has a value which supersedes both lca values, and
1075
                    # other only has an lca value
1076
                    return 'this'
1077
            elif this in unique_lca_vals:
1078
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1079
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1080
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1081
1082
        # At this point, the lcas disagree, and the tips disagree
1083
        return 'conflict'
1084
1085
    @staticmethod
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1086
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
1087
        """Do a three-way test on a scalar.
1088
        Return "this", "other" or "conflict", depending whether a value wins.
1089
        """
1090
        key_base = key(base_tree, file_id)
1091
        key_other = key(other_tree, file_id)
1092
        #if base == other, either they all agree, or only THIS has changed.
1093
        if key_base == key_other:
1094
            return "this"
1095
        key_this = key(this_tree, file_id)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1096
        # "Ambiguous clean merge"
1097
        if key_this == key_other:
1098
            return "this"
1099
        elif key_this == key_base:
1100
            return "other"
1101
        else:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1102
            return "conflict"
1103
1104
    def merge_names(self, file_id):
1105
        def get_entry(tree):
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1106
            if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1107
                return tree.inventory[file_id]
1108
            else:
1109
                return None
1110
        this_entry = get_entry(self.this_tree)
1111
        other_entry = get_entry(self.other_tree)
1112
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1113
        entries = (base_entry, other_entry, this_entry)
1114
        names = []
1115
        parents = []
1116
        for entry in entries:
1117
            if entry is None:
1118
                names.append(None)
1119
                parents.append(None)
1120
            else:
1121
                names.append(entry.name)
1122
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1123
        return self._merge_names(file_id, parents, names,
1124
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1125
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1126
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1127
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1128
        base_name, other_name, this_name = names
1129
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1130
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1131
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1132
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1133
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1134
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1135
            if name_winner == "this":
1136
                name_winner = "other"
1137
            if parent_id_winner == "this":
1138
                parent_id_winner = "other"
1139
        if name_winner == "this" and parent_id_winner == "this":
1140
            return
1141
        if name_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1142
            trans_id = self.tt.trans_id_file_id(file_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1143
            self._raw_conflicts.append(('name conflict', trans_id,
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1144
                                        this_name, other_name))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1145
        if parent_id_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1146
            trans_id = self.tt.trans_id_file_id(file_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1147
            self._raw_conflicts.append(('parent conflict', trans_id,
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1148
                                        this_parent, other_parent))
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1149
        if other_name is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1150
            # it doesn't matter whether the result was 'other' or
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1151
            # 'conflict'-- if there's no 'other', we leave it alone.
1152
            return
1153
        # if we get here, name_winner and parent_winner are set to safe values.
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1154
        trans_id = self.tt.trans_id_file_id(file_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1155
        parent_id = parents[self.winner_idx[parent_id_winner]]
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1156
        if parent_id is not None:
1157
            parent_trans_id = self.tt.trans_id_file_id(parent_id)
2590.2.7 by Aaron Bentley
Misc cleanup
1158
            self.tt.adjust_path(names[self.winner_idx[name_winner]],
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1159
                                parent_trans_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1160
1161
    def merge_contents(self, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1162
        """Performs a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1163
        def contents_pair(tree):
1164
            if file_id not in tree:
1165
                return (None, None)
1166
            kind = tree.kind(file_id)
1167
            if kind == "file":
1168
                contents = tree.get_file_sha1(file_id)
1169
            elif kind == "symlink":
1170
                contents = tree.get_symlink_target(file_id)
1171
            else:
1172
                contents = None
1173
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1174
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1175
        # See SPOT run.  run, SPOT, run.
1176
        # So we're not QUITE repeating ourselves; we do tricky things with
1177
        # file kind...
1178
        base_pair = contents_pair(self.base_tree)
1179
        other_pair = contents_pair(self.other_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1180
        if self._lca_trees:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1181
            this_pair = contents_pair(self.this_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1182
            lca_pairs = [contents_pair(tree) for tree in self._lca_trees]
1183
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1184
                                         this_pair, allow_overriding_lca=False)
1185
        else:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1186
            if base_pair == other_pair:
1187
                winner = 'this'
1188
            else:
1189
                # We delayed evaluating this_pair as long as we can to avoid
1190
                # unnecessary sha1 calculation
1191
                this_pair = contents_pair(self.this_tree)
1192
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1193
        if winner == 'this':
1194
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1195
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1196
        # We have a hypothetical conflict, but if we have files, then we
1197
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1198
        trans_id = self.tt.trans_id_file_id(file_id)
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1199
        params = MergeHookParams(self, file_id, trans_id, this_pair[0],
1200
            other_pair[0], winner)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1201
        hooks = Merger.hooks['merge_file_content']
1202
        hooks = list(hooks) + [self.default_text_merge]
1203
        hook_status = 'not_applicable'
1204
        for hook in hooks:
1205
            hook_status, lines = hook(params)
1206
            if hook_status != 'not_applicable':
1207
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1208
                break
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1209
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1210
        if hook_status == 'not_applicable':
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1211
            # This is a contents conflict, because none of the available
1212
            # functions could merge it.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1213
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1214
            name = self.tt.final_name(trans_id)
1215
            parent_id = self.tt.final_parent(trans_id)
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1216
            if self.this_tree.has_id(file_id):
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1217
                self.tt.unversion_file(trans_id)
1218
            file_group = self._dump_conflicts(name, parent_id, file_id,
1219
                                              set_version=True)
1220
            self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1221
        elif hook_status == 'success':
1222
            self.tt.create_file(lines, trans_id)
1223
        elif hook_status == 'conflicted':
1224
            # XXX: perhaps the hook should be able to provide
1225
            # the BASE/THIS/OTHER files?
1226
            self.tt.create_file(lines, trans_id)
1227
            self._raw_conflicts.append(('text conflict', trans_id))
1228
            name = self.tt.final_name(trans_id)
1229
            parent_id = self.tt.final_parent(trans_id)
4869.3.23 by Andrew Bennetts
Remove some confusing code that has no effect.
1230
            self._dump_conflicts(name, parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1231
        elif hook_status == 'delete':
1232
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1233
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1234
        elif hook_status == 'done':
1235
            # The hook function did whatever it needs to do directly, no
1236
            # further action needed here.
1237
            pass
1238
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1239
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1240
        if not self.this_tree.has_id(file_id) and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1241
            self.tt.version_file(file_id, trans_id)
4869.3.31 by Andrew Bennetts
Add comment, improve doc string, remove redundant line.
1242
        # The merge has been performed, so the old contents should not be
1243
        # retained.
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1244
        try:
1245
            self.tt.delete_contents(trans_id)
1246
        except errors.NoSuchFile:
1247
            pass
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1248
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1249
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1250
    def _default_other_winner_merge(self, merge_hook_params):
1251
        """Replace this contents with other."""
1252
        file_id = merge_hook_params.file_id
1253
        trans_id = merge_hook_params.trans_id
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1254
        file_in_this = self.this_tree.has_id(file_id)
1255
        if self.other_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1256
            # OTHER changed the file
1257
            wt = self.this_tree
1258
            if wt.supports_content_filtering():
1259
                # We get the path from the working tree if it exists.
1260
                # That fails though when OTHER is adding a file, so
1261
                # we fall back to the other tree to find the path if
1262
                # it doesn't exist locally.
1263
                try:
1264
                    filter_tree_path = wt.id2path(file_id)
1265
                except errors.NoSuchId:
1266
                    filter_tree_path = self.other_tree.id2path(file_id)
1267
            else:
1268
                # Skip the id2path lookup for older formats
1269
                filter_tree_path = None
1270
            transform.create_from_tree(self.tt, trans_id,
1271
                             self.other_tree, file_id,
1272
                             filter_tree_path=filter_tree_path)
1273
            return 'done', None
1274
        elif file_in_this:
1275
            # OTHER deleted the file
1276
            return 'delete', None
1277
        else:
1278
            raise AssertionError(
1279
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1280
                % (file_id,))
1281
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1282
    def default_text_merge(self, merge_hook_params):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1283
        if merge_hook_params.winner == 'other':
1284
            # OTHER is a straight winner, so replace this contents with other
1285
            return self._default_other_winner_merge(merge_hook_params)
1286
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1287
            # THIS and OTHER are both files, so text merge.  Either
1288
            # BASE is a file, or both converted to files, so at least we
1289
            # have agreement that output should be a file.
1290
            try:
1291
                self.text_merge(merge_hook_params.file_id,
1292
                    merge_hook_params.trans_id)
1293
            except errors.BinaryFile:
1294
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1295
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1296
        else:
1297
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1298
1299
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1300
        """Return the lines in a file, or an empty list."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1301
        if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1302
            return tree.get_file(file_id).readlines()
1303
        else:
1304
            return []
1305
1306
    def text_merge(self, file_id, trans_id):
1307
        """Perform a three-way text merge on a file_id"""
1308
        # it's possible that we got here with base as a different type.
1309
        # if so, we just want two-way text conflicts.
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1310
        if self.base_tree.has_id(file_id) and \
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1311
            self.base_tree.kind(file_id) == "file":
1312
            base_lines = self.get_lines(self.base_tree, file_id)
1313
        else:
1314
            base_lines = []
1315
        other_lines = self.get_lines(self.other_tree, file_id)
1316
        this_lines = self.get_lines(self.this_tree, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1317
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1318
                           is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1319
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1320
        if self.show_base is True:
1321
            base_marker = '|' * 7
1322
        else:
1323
            base_marker = None
1324
1325
        def iter_merge3(retval):
1326
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1327
            for line in m3.merge_lines(name_a = "TREE",
1328
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1329
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1330
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1331
                                       base_marker=base_marker,
1332
                                       reprocess=self.reprocess):
1333
                if line.startswith(start_marker):
1334
                    retval["text_conflicts"] = True
1335
                    yield line.replace(start_marker, '<' * 7)
1336
                else:
1337
                    yield line
1338
        retval = {}
1339
        merge3_iterator = iter_merge3(retval)
1340
        self.tt.create_file(merge3_iterator, trans_id)
1341
        if retval["text_conflicts"] is True:
1342
            self._raw_conflicts.append(('text conflict', trans_id))
1343
            name = self.tt.final_name(trans_id)
1344
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1345
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1346
                                              this_lines, base_lines,
1347
                                              other_lines)
1348
            file_group.append(trans_id)
1349
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1350
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1351
                        base_lines=None, other_lines=None, set_version=False,
1352
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1353
        """Emit conflict files.
1354
        If this_lines, base_lines, or other_lines are omitted, they will be
1355
        determined automatically.  If set_version is true, the .OTHER, .THIS
1356
        or .BASE (in that order) will be created as versioned files.
1357
        """
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1358
        data = [('OTHER', self.other_tree, other_lines),
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1359
                ('THIS', self.this_tree, this_lines)]
1360
        if not no_base:
1361
            data.append(('BASE', self.base_tree, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1362
1363
        # We need to use the actual path in the working tree of the file here,
1364
        # ignoring the conflict suffixes
1365
        wt = self.this_tree
1366
        if wt.supports_content_filtering():
1367
            try:
1368
                filter_tree_path = wt.id2path(file_id)
1369
            except errors.NoSuchId:
1370
                # file has been deleted
1371
                filter_tree_path = None
1372
        else:
1373
            # Skip the id2path lookup for older formats
1374
            filter_tree_path = None
1375
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1376
        versioned = False
1377
        file_group = []
1378
        for suffix, tree, lines in data:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1379
            if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1380
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1381
                                               suffix, lines, filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1382
                file_group.append(trans_id)
1383
                if set_version and not versioned:
1384
                    self.tt.version_file(file_id, trans_id)
1385
                    versioned = True
1386
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1387
3363.17.21 by Aaron Bentley
Conflicts are handled when merging from preview trees
1388
    def _conflict_file(self, name, parent_id, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1389
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1390
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1391
        name = name + '.' + suffix
1392
        trans_id = self.tt.create_path(name, parent_id)
4854.1.1 by Andrew Bennetts
Merge lp:bzr/2.0 into lp:bzr.
1393
        transform.create_from_tree(self.tt, trans_id, tree, file_id, lines,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1394
            filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1395
        return trans_id
1396
1397
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1398
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1399
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1400
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1401
        self._merge_executable(file_id, executable, file_status,
1402
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1403
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1404
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1405
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1406
        """Perform a merge on the execute bit."""
1407
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1408
        if file_status == "deleted":
1409
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1410
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1411
        if winner == "conflict":
1412
        # There must be a None in here, if we have a conflict, but we
1413
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1414
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1415
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1416
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1417
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1418
        if winner == 'this' and file_status != "modified":
1419
            return
1420
        trans_id = self.tt.trans_id_file_id(file_id)
1421
        try:
1422
            if self.tt.final_kind(trans_id) != "file":
1423
                return
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1424
        except errors.NoSuchFile:
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1425
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1426
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1427
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1428
        else:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1429
            if self.other_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1430
                executability = other_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1431
            elif self.this_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1432
                executability = this_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1433
            elif self.base_tree_has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1434
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1435
        if executability is not None:
1436
            trans_id = self.tt.trans_id_file_id(file_id)
1437
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1438
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1439
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1440
        """Convert all conflicts into a form that doesn't depend on trans_id"""
1441
        name_conflicts = {}
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1442
        self.cooked_conflicts.extend(transform.cook_conflicts(
1443
                fs_conflicts, self.tt))
1444
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1445
        for conflict in self._raw_conflicts:
1446
            conflict_type = conflict[0]
1447
            if conflict_type in ('name conflict', 'parent conflict'):
1448
                trans_id = conflict[1]
1449
                conflict_args = conflict[2:]
1450
                if trans_id not in name_conflicts:
1451
                    name_conflicts[trans_id] = {}
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1452
                transform.unique_add(name_conflicts[trans_id], conflict_type,
1453
                                     conflict_args)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1454
            if conflict_type == 'contents conflict':
1455
                for trans_id in conflict[1]:
1456
                    file_id = self.tt.final_file_id(trans_id)
1457
                    if file_id is not None:
1458
                        break
1459
                path = fp.get_path(trans_id)
1460
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1461
                    if path.endswith(suffix):
1462
                        path = path[:-len(suffix)]
1463
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1464
                c = _mod_conflicts.Conflict.factory(conflict_type,
1465
                                                    path=path, file_id=file_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1466
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1467
            if conflict_type == 'text conflict':
1468
                trans_id = conflict[1]
1469
                path = fp.get_path(trans_id)
1470
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1471
                c = _mod_conflicts.Conflict.factory(conflict_type,
1472
                                                    path=path, file_id=file_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1473
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1474
1475
        for trans_id, conflicts in name_conflicts.iteritems():
1476
            try:
1477
                this_parent, other_parent = conflicts['parent conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1478
                if this_parent == other_parent:
1479
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1480
            except KeyError:
1481
                this_parent = other_parent = \
1482
                    self.tt.final_file_id(self.tt.final_parent(trans_id))
1483
            try:
1484
                this_name, other_name = conflicts['name conflict']
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1485
                if this_name == other_name:
1486
                    raise AssertionError()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1487
            except KeyError:
1488
                this_name = other_name = self.tt.final_name(trans_id)
1489
            other_path = fp.get_path(trans_id)
1551.16.2 by Aaron Bentley
Don't crash on merging renamed deleted files (#110279)
1490
            if this_parent is not None and this_name is not None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1491
                this_parent_path = \
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
1492
                    fp.get_path(self.tt.trans_id_file_id(this_parent))
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1493
                this_path = osutils.pathjoin(this_parent_path, this_name)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1494
            else:
1495
                this_path = "<deleted>"
1496
            file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1497
            c = _mod_conflicts.Conflict.factory('path conflict', path=this_path,
1498
                                                conflict_path=other_path,
1499
                                                file_id=file_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1500
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1501
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1502
1503
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1504
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1505
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1506
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1507
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1508
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1509
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1510
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1511
    def _generate_merge_plan(self, file_id, base):
1512
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1513
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1514
1515
    def _merged_lines(self, file_id):
1516
        """Generate the merged lines.
1517
        There is no distinction between lines that are meant to contain <<<<<<<
1518
        and conflicts.
1519
        """
1520
        if self.cherrypick:
1521
            base = self.base_tree
1522
        else:
1523
            base = None
1524
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1525
        if 'merge' in debug.debug_flags:
1526
            plan = list(plan)
1527
            trans_id = self.tt.trans_id_file_id(file_id)
1528
            name = self.tt.final_name(trans_id) + '.plan'
4634.101.6 by John Arbash Meinel
killed-both and killed-base is 11 chars long.
1529
            contents = ('%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1530
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1531
        textmerge = versionedfile.PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1532
                                                 '>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1533
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1534
        if conflicts:
1535
            base_lines = textmerge.base_from_plan()
1536
        else:
1537
            base_lines = None
1538
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1539
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1540
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1541
        """Perform a (weave) text merge for a given file and file-id.
1542
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1543
        and a conflict will be noted.
1544
        """
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1545
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1546
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1547
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1548
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1549
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1550
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1551
        if base_lines is not None:
1552
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1553
            self._raw_conflicts.append(('text conflict', trans_id))
1554
            name = self.tt.final_name(trans_id)
1555
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1556
            file_group = self._dump_conflicts(name, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1557
                                              no_base=False,
1558
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1559
            file_group.append(trans_id)
1560
1561
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1562
class LCAMerger(WeaveMerger):
1563
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1564
    def _generate_merge_plan(self, file_id, base):
1565
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1566
                                                  base=base)
1567
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1568
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1569
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1570
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1571
    def dump_file(self, temp_dir, name, tree, file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1572
        out_path = osutils.pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1573
        out_file = open(out_path, "wb")
1574
        try:
1575
            in_file = tree.get_file(file_id)
1576
            for line in in_file:
1577
                out_file.write(line)
1578
        finally:
1579
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1580
        return out_path
1581
1582
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1583
        """Perform a diff3 merge using a specified file-id and trans-id.
1584
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1585
        will be dumped, and a will be conflict noted.
1586
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1587
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1588
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1589
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1590
            new_file = osutils.pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1591
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1592
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1593
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1594
            status = bzrlib.patch.diff3(new_file, this, base, other)
1595
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1596
                raise errors.BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1597
            f = open(new_file, 'rb')
1598
            try:
1599
                self.tt.create_file(f, trans_id)
1600
            finally:
1601
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1602
            if status == 1:
1603
                name = self.tt.final_name(trans_id)
1604
                parent_id = self.tt.final_parent(trans_id)
1605
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1606
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1607
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1608
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1609
1610
1611
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1612
                backup_files=False,
1613
                merge_type=Merge3Merger,
1614
                interesting_ids=None,
1615
                show_base=False,
1616
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1617
                other_rev_id=None,
1618
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1619
                this_tree=None,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1620
                pb=progress.DummyProgress(),
1551.11.10 by Aaron Bentley
Add change reporting to pull
1621
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1622
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1623
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1624
        typical use is probably
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1625
        'merge_inner(branch, branch.get_revision_tree(other_revision),
1626
                     branch.get_revision_tree(base_revision))'
1627
        """
1628
    if this_tree is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1629
        raise errors.BzrError("bzrlib.merge.merge_inner requires a this_tree "
1630
                              "parameter as of bzrlib version 0.8.")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1631
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1632
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1633
    merger.backup_files = backup_files
1634
    merger.merge_type = merge_type
1635
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1636
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1637
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1638
        if interesting_ids:
1639
            raise ValueError('Only supply interesting_ids'
1640
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1641
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1642
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1643
    merger.reprocess = reprocess
1644
    merger.other_rev_id = other_rev_id
1645
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1646
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1647
    if get_revision_id is None:
1648
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1649
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1650
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1651
    return merger.do_merge()
1652
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1653
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1654
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1655
1656
    This method provides a sanctioned way to retrieve it.
1657
    """
1658
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1659
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1660
1661
1662
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1663
    def status_a(revision, text):
1664
        if revision in ancestors_b:
1665
            return 'killed-b', text
1666
        else:
1667
            return 'new-a', text
1668
1669
    def status_b(revision, text):
1670
        if revision in ancestors_a:
1671
            return 'killed-a', text
1672
        else:
1673
            return 'new-b', text
1674
1675
    plain_a = [t for (a, t) in annotated_a]
1676
    plain_b = [t for (a, t) in annotated_b]
1677
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1678
    blocks = matcher.get_matching_blocks()
1679
    a_cur = 0
1680
    b_cur = 0
1681
    for ai, bi, l in blocks:
1682
        # process all mismatched sections
1683
        # (last mismatched section is handled because blocks always
1684
        # includes a 0-length last block)
1685
        for revision, text in annotated_a[a_cur:ai]:
1686
            yield status_a(revision, text)
1687
        for revision, text in annotated_b[b_cur:bi]:
1688
            yield status_b(revision, text)
1689
        # and now the matched section
1690
        a_cur = ai + l
1691
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
1692
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
1693
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1694
1695
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1696
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1697
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1698
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1699
        """Contructor.
1700
1701
        :param a_rev: Revision-id of one revision to merge
1702
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1703
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1704
        :param key_prefix: A prefix for accessing keys in vf, typically
1705
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1706
        """
1707
        self.a_rev = a_rev
1708
        self.b_rev = b_rev
1709
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
1710
        self._last_lines = None
1711
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
1712
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1713
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1714
        self._precache_tip_lines()
1715
1716
    def _precache_tip_lines(self):
1717
        lines = self.get_lines([self.a_rev, self.b_rev])
1718
        self.lines_a = lines[self.a_rev]
1719
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1720
1721
    def get_lines(self, revisions):
1722
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
1723
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1724
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1725
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1726
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1727
        result = {}
1728
        for record in self.vf.get_record_stream(keys, 'unordered', True):
1729
            if record.storage_kind == 'absent':
1730
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
1731
            result[record.key[-1]] = osutils.chunks_to_lines(
1732
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1733
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1734
1735
    def plan_merge(self):
1736
        """Generate a 'plan' for merging the two revisions.
1737
1738
        This involves comparing their texts and determining the cause of
1739
        differences.  If text A has a line and text B does not, then either the
1740
        line was added to text A, or it was deleted from B.  Once the causes
1741
        are combined, they are written out in the format described in
1742
        VersionedFile.plan_merge
1743
        """
1744
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1745
        unique_a, unique_b = self._unique_lines(blocks)
1746
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
1747
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
1748
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
1749
1750
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1751
        last_i = 0
1752
        last_j = 0
1753
        for i, j, n in blocks:
1754
            for a_index in range(last_i, i):
1755
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
1756
                    if a_index in killed_b:
1757
                        yield 'conflicted-a', self.lines_a[a_index]
1758
                    else:
1759
                        yield 'new-a', self.lines_a[a_index]
1760
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1761
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1762
            for b_index in range(last_j, j):
1763
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
1764
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
1765
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
1766
                    else:
1767
                        yield 'new-b', self.lines_b[b_index]
1768
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1769
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1770
            # handle common lines
1771
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1772
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1773
            last_i = i+n
1774
            last_j = j+n
1775
1776
    def _get_matching_blocks(self, left_revision, right_revision):
1777
        """Return a description of which sections of two revisions match.
1778
1779
        See SequenceMatcher.get_matching_blocks
1780
        """
3144.3.7 by Aaron Bentley
Update from review
1781
        cached = self._cached_matching_blocks.get((left_revision,
1782
                                                   right_revision))
1783
        if cached is not None:
1784
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
1785
        if self._last_lines_revision_id == left_revision:
1786
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1787
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1788
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
1789
            lines = self.get_lines([left_revision, right_revision])
1790
            left_lines = lines[left_revision]
1791
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
1792
        self._last_lines = right_lines
1793
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1794
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
1795
                                                       right_lines)
1796
        return matcher.get_matching_blocks()
1797
1798
    def _unique_lines(self, matching_blocks):
1799
        """Analyse matching_blocks to determine which lines are unique
1800
1801
        :return: a tuple of (unique_left, unique_right), where the values are
1802
            sets of line numbers of unique lines.
1803
        """
1804
        last_i = 0
1805
        last_j = 0
1806
        unique_left = []
1807
        unique_right = []
1808
        for i, j, n in matching_blocks:
1809
            unique_left.extend(range(last_i, i))
1810
            unique_right.extend(range(last_j, j))
1811
            last_i = i + n
1812
            last_j = j + n
1813
        return unique_left, unique_right
1814
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1815
    @staticmethod
1816
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
1817
        """Remove changes from new_plan that came from old_plan.
1818
1819
        It is assumed that the difference between the old_plan and new_plan
1820
        is their choice of 'b' text.
1821
1822
        All lines from new_plan that differ from old_plan are emitted
1823
        verbatim.  All lines from new_plan that match old_plan but are
1824
        not about the 'b' revision are emitted verbatim.
1825
1826
        Lines that match and are about the 'b' revision are the lines we
1827
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
1828
        is skipped entirely.
1829
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1830
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
1831
                                                       new_plan)
1832
        last_j = 0
1833
        for i, j, n in matcher.get_matching_blocks():
1834
            for jj in range(last_j, j):
1835
                yield new_plan[jj]
1836
            for jj in range(j, j+n):
1837
                plan_line = new_plan[jj]
1838
                if plan_line[0] == 'new-b':
1839
                    pass
1840
                elif plan_line[0] == 'killed-b':
1841
                    yield 'unchanged', plan_line[1]
1842
                else:
1843
                    yield plan_line
1844
            last_j = j + n
1845
1846
1847
class _PlanMerge(_PlanMergeBase):
1848
    """Plan an annotate merge using on-the-fly annotation"""
1849
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1850
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1851
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
1852
        self.a_key = self._key_prefix + (self.a_rev,)
1853
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1854
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
1855
        heads = self.graph.heads((self.a_key, self.b_key))
1856
        if len(heads) == 1:
1857
            # one side dominates, so we can just return its values, yay for
1858
            # per-file graphs
1859
            # Ideally we would know that before we get this far
1860
            self._head_key = heads.pop()
1861
            if self._head_key == self.a_key:
1862
                other = b_rev
1863
            else:
1864
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1865
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
1866
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
1867
            self._weave = None
1868
        else:
1869
            self._head_key = None
1870
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1871
1872
    def _precache_tip_lines(self):
1873
        # Turn this into a no-op, because we will do this later
1874
        pass
1875
1876
    def _find_recursive_lcas(self):
1877
        """Find all the ancestors back to a unique lca"""
1878
        cur_ancestors = (self.a_key, self.b_key)
1879
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1880
        # rather than a key tuple. We will just map that directly to no common
1881
        # ancestors.
1882
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1883
        while True:
1884
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1885
            # Map a plain NULL_REVISION to a simple no-ancestors
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1886
            if next_lcas == set([_mod_revision.NULL_REVISION]):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1887
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1888
            # Order the lca's based on when they were merged into the tip
1889
            # While the actual merge portion of weave merge uses a set() of
1890
            # active revisions, the order of insertion *does* effect the
1891
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1892
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1893
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
1894
                                                                    next_lcas))
1895
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1896
            if len(next_lcas) == 0:
1897
                break
1898
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
1899
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1900
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
1901
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1902
                # More than 2 lca's, fall back to grabbing all nodes between
1903
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1904
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
1905
                             ' %s, %s\n=> %s',
1906
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1907
                cur_lcas = next_lcas
1908
                while len(cur_lcas) > 1:
1909
                    cur_lcas = self.graph.find_lca(*cur_lcas)
1910
                if len(cur_lcas) == 0:
1911
                    # No common base to find, use the full ancestry
1912
                    unique_lca = None
1913
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
1914
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1915
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1916
                        # find_lca will return a plain 'NULL_REVISION' rather
1917
                        # than a key tuple when there is no common ancestor, we
1918
                        # prefer to just use None, because it doesn't confuse
1919
                        # _get_interesting_texts()
1920
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1921
                parent_map.update(self._find_unique_parents(next_lcas,
1922
                                                            unique_lca))
1923
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1924
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
1925
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
1926
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1927
    def _find_unique_parents(self, tip_keys, base_key):
1928
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1929
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1930
        :param tip_keys: Nodes that are interesting
1931
        :param base_key: Cull all ancestors of this node
1932
        :return: The parent map for all revisions between tip_keys and
1933
            base_key. base_key will be included. References to nodes outside of
1934
            the ancestor set will also be removed.
1935
        """
1936
        # TODO: this would be simpler if find_unique_ancestors took a list
1937
        #       instead of a single tip, internally it supports it, but it
1938
        #       isn't a "backwards compatible" api change.
1939
        if base_key is None:
1940
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1941
            # We remove NULL_REVISION because it isn't a proper tuple key, and
1942
            # thus confuses things like _get_interesting_texts, and our logic
1943
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1944
            if _mod_revision.NULL_REVISION in parent_map:
1945
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1946
        else:
1947
            interesting = set()
1948
            for tip in tip_keys:
1949
                interesting.update(
1950
                    self.graph.find_unique_ancestors(tip, [base_key]))
1951
            parent_map = self.graph.get_parent_map(interesting)
1952
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1953
        culled_parent_map, child_map, tails = self._remove_external_references(
1954
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1955
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
1956
        if base_key is not None:
1957
            tails.remove(base_key)
1958
            self._prune_tails(culled_parent_map, child_map, tails)
1959
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
1960
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
1961
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1962
1963
    @staticmethod
1964
    def _remove_external_references(parent_map):
1965
        """Remove references that go outside of the parent map.
1966
1967
        :param parent_map: Something returned from Graph.get_parent_map(keys)
1968
        :return: (filtered_parent_map, child_map, tails)
1969
            filtered_parent_map is parent_map without external references
1970
            child_map is the {parent_key: [child_keys]} mapping
1971
            tails is a list of nodes that do not have any parents in the map
1972
        """
1973
        # TODO: The basic effect of this function seems more generic than
1974
        #       _PlanMerge. But the specific details of building a child_map,
1975
        #       and computing tails seems very specific to _PlanMerge.
1976
        #       Still, should this be in Graph land?
1977
        filtered_parent_map = {}
1978
        child_map = {}
1979
        tails = []
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
1980
        for key, parent_keys in parent_map.iteritems():
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
1981
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
1982
            if not culled_parent_keys:
1983
                tails.append(key)
1984
            for parent_key in culled_parent_keys:
1985
                child_map.setdefault(parent_key, []).append(key)
1986
            # TODO: Do we want to do this, it adds overhead for every node,
1987
            #       just to say that the node has no children
1988
            child_map.setdefault(key, [])
1989
            filtered_parent_map[key] = culled_parent_keys
1990
        return filtered_parent_map, child_map, tails
1991
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1992
    @staticmethod
1993
    def _prune_tails(parent_map, child_map, tails_to_remove):
1994
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1995
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
1996
        This will remove the supplied revisions until no more children have 0
1997
        parents.
1998
1999
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2000
            be modified in place.
2001
        :param tails_to_remove: A list of tips that should be removed,
2002
            this list will be consumed
2003
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2004
            this dict will be modified
2005
        :return: None, parent_map will be modified in place.
2006
        """
2007
        while tails_to_remove:
2008
            next = tails_to_remove.pop()
2009
            parent_map.pop(next)
2010
            children = child_map.pop(next)
2011
            for child in children:
2012
                child_parents = parent_map[child]
2013
                child_parents.remove(next)
2014
                if len(child_parents) == 0:
2015
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2016
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2017
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2018
        """Return a dict of texts we are interested in.
2019
2020
        Note that the input is in key tuples, but the output is in plain
2021
        revision ids.
2022
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2023
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2024
        :return: A dict of {'revision_id':lines} as returned by
2025
            _PlanMergeBase.get_lines()
2026
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2027
        all_revision_keys = set(parent_map)
2028
        all_revision_keys.add(self.a_key)
2029
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2030
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2031
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2032
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2033
        return all_texts
2034
2035
    def _build_weave(self):
2036
        from bzrlib import weave
2037
        self._weave = weave.Weave(weave_name='in_memory_weave',
2038
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2039
        parent_map = self._find_recursive_lcas()
2040
2041
        all_texts = self._get_interesting_texts(parent_map)
2042
2043
        # Note: Unfortunately, the order given by topo_sort will effect the
2044
        # ordering resolution in the output. Specifically, if you add A then B,
2045
        # then in the output text A lines will show up before B lines. And, of
2046
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2047
        # So we use merge_sort, and add a fake node on the tip.
2048
        # This ensures that left-hand parents will always be inserted into the
2049
        # weave before right-hand parents.
2050
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2051
        parent_map[tip_key] = (self.a_key, self.b_key)
2052
2053
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2054
                                                                  tip_key)):
2055
            if key == tip_key:
2056
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2057
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2058
            parent_keys = parent_map[key]
2059
            revision_id = key[-1]
2060
            parent_ids = [k[-1] for k in parent_keys]
2061
            self._weave.add_lines(revision_id, parent_ids,
2062
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2063
2064
    def plan_merge(self):
2065
        """Generate a 'plan' for merging the two revisions.
2066
2067
        This involves comparing their texts and determining the cause of
2068
        differences.  If text A has a line and text B does not, then either the
2069
        line was added to text A, or it was deleted from B.  Once the causes
2070
        are combined, they are written out in the format described in
2071
        VersionedFile.plan_merge
2072
        """
2073
        if self._head_key is not None: # There was a single head
2074
            if self._head_key == self.a_key:
2075
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2076
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2077
                if self._head_key != self.b_key:
2078
                    raise AssertionError('There was an invalid head: %s != %s'
2079
                                         % (self.b_key, self._head_key))
2080
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2081
            head_rev = self._head_key[-1]
2082
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2083
            return ((plan, line) for line in lines)
2084
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2085
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2086
2087
class _PlanLCAMerge(_PlanMergeBase):
2088
    """
3144.3.7 by Aaron Bentley
Update from review
2089
    This merge algorithm differs from _PlanMerge in that:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2090
    1. comparisons are done against LCAs only
2091
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2092
       another are marked as conflicts, by emitting the line as conflicted-a
2093
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2094
2095
    This is faster, and hopefully produces more useful output.
2096
    """
2097
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2098
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2099
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2100
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2101
        self.lcas = set()
2102
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2103
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2104
                self.lcas.add(lca)
2105
            else:
2106
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2107
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2108
            if _mod_revision.is_null(lca):
2109
                lca_lines = []
2110
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2111
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2112
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2113
                                                           lca_lines)
2114
            blocks = list(matcher.get_matching_blocks())
2115
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2116
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2117
                                                           lca_lines)
2118
            blocks = list(matcher.get_matching_blocks())
2119
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2120
3144.3.7 by Aaron Bentley
Update from review
2121
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2122
        """Determines the status unique lines versus all lcas.
2123
2124
        Basically, determines why the line is unique to this revision.
2125
2126
        A line may be determined new, killed, or both.
2127
3144.3.7 by Aaron Bentley
Update from review
2128
        If a line is determined new, that means it was not present in at least
2129
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2130
2131
        If a line is determined killed, that means the line was present in
2132
        at least one LCA.
2133
2134
        If a line is killed and new, this indicates that the two merge
2135
        revisions contain differing conflict resolutions.
3144.3.7 by Aaron Bentley
Update from review
2136
        :param revision_id: The id of the revision in which the lines are
2137
            unique
2138
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2139
        :return a tuple of (new_this, killed_other):
2140
        """
2141
        new = set()
2142
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2143
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2144
        for lca in self.lcas:
2145
            blocks = self._get_matching_blocks(revision_id, lca)
2146
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2147
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2148
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2149
        return new, killed