/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
17
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
18
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
19
from bzrlib.lazy_import import lazy_import
20
lazy_import(globals(), """
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
21
from bzrlib import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
22
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
23
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
25
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
26
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
27
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
28
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
29
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
30
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
31
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
32
    textfile,
33
    trace,
34
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
35
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
36
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
37
    ui,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
38
    versionedfile,
5246.2.27 by Andrew Bennetts
Remove merge_into_helper for now, as it currently has no callers.
39
    workingtree,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
40
    )
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
41
from bzrlib.i18n import gettext
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
42
""")
43
from bzrlib import (
44
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
45
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
46
    hooks,
47
    )
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
48
from bzrlib.symbol_versioning import (
49
    deprecated_in,
50
    deprecated_method,
51
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
52
# TODO: Report back as changes are merged in
53
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
54
1185.35.4 by Aaron Bentley
Implemented remerge
55
def transform_tree(from_tree, to_tree, interesting_ids=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
56
    from_tree.lock_tree_write()
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
57
    operation = cleanup.OperationWithCleanups(merge_inner)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
58
    operation.add_cleanup(from_tree.unlock)
59
    operation.run_simple(from_tree.branch, to_tree, from_tree,
60
        ignore_zero=True, interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
61
1457.1.12 by Robert Collins
Update comment to reflect author.
62
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
63
class MergeHooks(hooks.Hooks):
64
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
65
    def __init__(self):
66
        hooks.Hooks.__init__(self, "bzrlib.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
67
        self.add_hook('merge_file_content',
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
68
            "Called with a bzrlib.merge.Merger object to create a per file "
69
            "merge object when starting a merge. "
70
            "Should return either None or a subclass of "
71
            "``bzrlib.merge.AbstractPerFileMerger``. "
72
            "Such objects will then be called per file "
73
            "that needs to be merged (including when one "
74
            "side has deleted the file and the other has changed it). "
75
            "See the AbstractPerFileMerger API docs for details on how it is "
76
            "used by merge.",
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
77
            (2, 1))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
78
79
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
80
class AbstractPerFileMerger(object):
81
    """PerFileMerger objects are used by plugins extending merge for bzrlib.
82
83
    See ``bzrlib.plugins.news_merge.news_merge`` for an example concrete class.
84
    
85
    :ivar merger: The Merge3Merger performing the merge.
86
    """
87
88
    def __init__(self, merger):
89
        """Create a PerFileMerger for use with merger."""
90
        self.merger = merger
91
92
    def merge_contents(self, merge_params):
93
        """Attempt to merge the contents of a single file.
94
        
95
        :param merge_params: A bzrlib.merge.MergeHookParams
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
96
        :return: A tuple of (status, chunks), where status is one of
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
97
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
98
            is 'success' or 'conflicted', then chunks should be an iterable of
99
            strings for the new file contents.
100
        """
101
        return ('not applicable', None)
102
103
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
104
class PerFileMerger(AbstractPerFileMerger):
105
    """Merge individual files when self.file_matches returns True.
106
107
    This class is intended to be subclassed.  The file_matches and
108
    merge_matching methods should be overridden with concrete implementations.
109
    """
110
111
    def file_matches(self, params):
112
        """Return True if merge_matching should be called on this file.
113
114
        Only called with merges of plain files with no clear winner.
115
116
        Subclasses must override this.
117
        """
118
        raise NotImplementedError(self.file_matches)
119
120
    def get_filename(self, params, tree):
121
        """Lookup the filename (i.e. basename, not path), given a Tree (e.g.
122
        self.merger.this_tree) and a MergeHookParams.
123
        """
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
124
        return osutils.basename(tree.id2path(params.file_id))
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
125
126
    def get_filepath(self, params, tree):
127
        """Calculate the path to the file in a tree.
128
129
        :param params: A MergeHookParams describing the file to merge
130
        :param tree: a Tree, e.g. self.merger.this_tree.
131
        """
132
        return tree.id2path(params.file_id)
133
134
    def merge_contents(self, params):
135
        """Merge the contents of a single file."""
136
        # Check whether this custom merge logic should be used.
137
        if (
138
            # OTHER is a straight winner, rely on default merge.
139
            params.winner == 'other' or
140
            # THIS and OTHER aren't both files.
141
            not params.is_file_merge() or
142
            # The filename doesn't match *.xml
143
            not self.file_matches(params)):
144
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
145
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
146
147
    def merge_matching(self, params):
148
        """Merge the contents of a single file that has matched the criteria
149
        in PerFileMerger.merge_contents (is a conflict, is a file,
150
        self.file_matches is True).
151
152
        Subclasses must override this.
153
        """
154
        raise NotImplementedError(self.merge_matching)
155
156
157
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
158
    """Merge individual files when configured via a .conf file.
159
160
    This is a base class for concrete custom file merging logic. Concrete
161
    classes should implement ``merge_text``.
162
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
163
    See ``bzrlib.plugins.news_merge.news_merge`` for an example concrete class.
164
    
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
165
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
166
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
167
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
168
        details. <name_prefix>_merge_files describes the files targeted by the
169
        hook for example.
170
        
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
171
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
172
        is present.
173
    """
174
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
175
    name_prefix = None
176
    default_files = None
177
178
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
179
        super(ConfigurableFileMerger, self).__init__(merger)
180
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
181
        self.default_files = self.__class__.default_files or []
182
        self.name_prefix = self.__class__.name_prefix
183
        if self.name_prefix is None:
184
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
185
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
186
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
187
        """Check whether the file should call the merge hook.
188
189
        <name_prefix>_merge_files configuration variable is a list of files
190
        that should use the hook.
191
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
192
        affected_files = self.affected_files
193
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
194
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
195
            # Until bzr provides a better policy for caching the config, we
196
            # just add the part we're interested in to the params to avoid
197
            # reading the config files repeatedly (bazaar.conf, location.conf,
198
            # branch.conf).
199
            config_key = self.name_prefix + '_merge_files'
200
            affected_files = config.get_user_option_as_list(config_key)
201
            if affected_files is None:
202
                # If nothing was specified in the config, use the default.
203
                affected_files = self.default_files
204
            self.affected_files = affected_files
205
        if affected_files:
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
206
            filepath = self.get_filepath(params, self.merger.this_tree)
207
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
208
                return True
209
        return False
210
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
211
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
212
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
213
214
    def merge_text(self, params):
215
        """Merge the byte contents of a single file.
216
217
        This is called after checking that the merge should be performed in
218
        merge_contents, and it should behave as per
219
        ``bzrlib.merge.AbstractPerFileMerger.merge_contents``.
220
        """
221
        raise NotImplementedError(self.merge_text)
222
223
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
224
class MergeHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
225
    """Object holding parameters passed to merge_file_content hooks.
226
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
227
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
228
229
    :ivar file_id: the file ID of the file being merged
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
230
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
231
    :ivar this_kind: kind of file_id in 'this' tree
232
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
233
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
234
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
235
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
236
    def __init__(self, merger, file_id, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
237
            winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
238
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
239
        self.file_id = file_id
240
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
241
        self.this_kind = this_kind
242
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
243
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
244
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
245
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
246
        """True if this_kind and other_kind are both 'file'."""
247
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
248
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
249
    @decorators.cachedproperty
250
    def base_lines(self):
251
        """The lines of the 'base' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
252
        return self._merger.get_lines(self._merger.base_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
253
254
    @decorators.cachedproperty
255
    def this_lines(self):
256
        """The lines of the 'this' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
257
        return self._merger.get_lines(self._merger.this_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
258
259
    @decorators.cachedproperty
260
    def other_lines(self):
261
        """The lines of the 'other' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
262
        return self._merger.get_lines(self._merger.other_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
263
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
264
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
265
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
266
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
267
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
268
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
269
    def __init__(self, this_branch, other_tree=None, base_tree=None,
1551.21.8 by Aaron Bentley
Remove now-redundant DummyProgress from Merger.__init__
270
                 this_tree=None, pb=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
271
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
272
        object.__init__(self)
273
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
274
        self.this_basis = _mod_revision.ensure_null(
275
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
276
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
277
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
278
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
279
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
280
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
281
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
282
        self.base_tree = base_tree
283
        self.ignore_zero = False
284
        self.backup_files = False
285
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
286
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
287
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
288
        self.reprocess = False
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
289
        if pb is not None:
290
            warnings.warn("pb parameter to Merger() is deprecated and ignored")
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
291
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
292
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
293
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
294
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
295
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
296
        self._base_is_ancestor = None
297
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
298
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
299
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
300
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
301
    def cache_trees_with_revision_ids(self, trees):
302
        """Cache any tree in trees if it has a revision_id."""
303
        for maybe_tree in trees:
304
            if maybe_tree is None:
305
                continue
306
            try:
307
                rev_id = maybe_tree.get_revision_id()
308
            except AttributeError:
309
                continue
310
            self._cached_trees[rev_id] = maybe_tree
311
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
312
    @property
313
    def revision_graph(self):
314
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
315
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
316
        return self._revision_graph
317
318
    def _set_base_is_ancestor(self, value):
319
        self._base_is_ancestor = value
320
321
    def _get_base_is_ancestor(self):
322
        if self._base_is_ancestor is None:
323
            self._base_is_ancestor = self.revision_graph.is_ancestor(
324
                self.base_rev_id, self.this_basis)
325
        return self._base_is_ancestor
326
327
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
328
329
    def _set_base_is_other_ancestor(self, value):
330
        self._base_is_other_ancestor = value
331
332
    def _get_base_is_other_ancestor(self):
333
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
334
            if self.other_basis is None:
335
                return True
336
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
337
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
338
        return self._base_is_other_ancestor
339
340
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
341
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
342
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
343
    @staticmethod
1551.21.7 by Aaron Bentley
Fix progress warning
344
    def from_uncommitted(tree, other_tree, pb=None, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
345
        """Return a Merger for uncommitted changes in other_tree.
346
347
        :param tree: The tree to merge into
348
        :param other_tree: The tree to get uncommitted changes from
349
        :param pb: A progress indicator
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
350
        :param base_tree: The basis to use for the merge.  If unspecified,
351
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
352
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
353
        if base_tree is None:
354
            base_tree = other_tree.basis_tree()
355
        merger = Merger(tree.branch, other_tree, base_tree, tree, pb)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
356
        merger.base_rev_id = merger.base_tree.get_revision_id()
357
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
358
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
359
        return merger
360
361
    @classmethod
362
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
363
        """Return a Merger for a bundle or merge directive.
364
365
        :param tree: The tree to merge changes into
366
        :param mergeable: A merge directive or bundle
367
        :param pb: A progress indicator
368
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
369
        mergeable.install_revisions(tree.branch.repository)
370
        base_revision_id, other_revision_id, verified =\
371
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
372
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
373
        if base_revision_id is not None:
374
            if (base_revision_id != _mod_revision.NULL_REVISION and
375
                revision_graph.is_ancestor(
376
                base_revision_id, tree.branch.last_revision())):
377
                base_revision_id = None
378
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
379
                trace.warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
380
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
381
                                         base_revision_id, revision_graph=
382
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
383
        return merger, verified
384
385
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
386
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
387
                          base_branch=None, revision_graph=None,
388
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
389
        """Return a Merger for revision-ids.
390
3363.17.15 by Aaron Bentley
Update docs
391
        :param pb: A progress indicator
1551.15.74 by Aaron Bentley
Textual updates from review
392
        :param tree: The tree to merge changes into
393
        :param other: The revision-id to use as OTHER
394
        :param base: The revision-id to use as BASE.  If not specified, will
395
            be auto-selected.
396
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
397
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
398
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
399
            not supplied, other_branch or tree.branch will be used.
400
        :param revision_graph: If you have a revision_graph precomputed, pass
401
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
402
        :param tree_branch: The branch associated with tree.  If not supplied,
403
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
404
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
405
        if tree_branch is None:
406
            tree_branch = tree.branch
407
        merger = Merger(tree_branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
408
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
409
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
410
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
411
        merger.set_other_revision(other, other_branch)
412
        if base is None:
413
            merger.find_base()
414
        else:
415
            if base_branch is None:
416
                base_branch = other_branch
417
            merger.set_base_revision(base, base_branch)
418
        return merger
419
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
420
    def revision_tree(self, revision_id, branch=None):
421
        if revision_id not in self._cached_trees:
422
            if branch is None:
423
                branch = self.this_branch
424
            try:
425
                tree = self.this_tree.revision_tree(revision_id)
426
            except errors.NoSuchRevisionInTree:
427
                tree = branch.repository.revision_tree(revision_id)
428
            self._cached_trees[revision_id] = tree
429
        return self._cached_trees[revision_id]
430
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
431
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
432
        location, revno = treespec
433
        if revno is None:
434
            tree = workingtree.WorkingTree.open_containing(location)[0]
435
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
436
        branch = _mod_branch.Branch.open_containing(
437
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
438
        if revno == -1:
439
            revision_id = branch.last_revision()
440
        else:
441
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
442
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
443
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
444
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
445
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
446
    def ensure_revision_trees(self):
447
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
448
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
449
            if self.this_basis == self.this_rev_id:
450
                self.this_revision_tree = self.this_basis_tree
451
1185.12.83 by Aaron Bentley
Preliminary weave merge support
452
        if self.other_rev_id is None:
453
            other_basis_tree = self.revision_tree(self.other_basis)
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
454
            if other_basis_tree.has_changes(self.other_tree):
4869.2.1 by Andrew Bennetts
Trivial improvements to bzrlib/merge.py suggested by pyflakes.
455
                raise errors.WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
456
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
457
            self.other_tree = other_basis_tree
458
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
459
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
460
    def file_revisions(self, file_id):
461
        self.ensure_revision_trees()
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
462
        if self.this_rev_id is None:
463
            if self.this_basis_tree.get_file_sha1(file_id) != \
464
                self.this_tree.get_file_sha1(file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
465
                raise errors.WorkingTreeNotRevision(self.this_tree)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
466
467
        trees = (self.this_basis_tree, self.other_tree)
5793.2.3 by Jelmer Vernooij
Add a RevisionTree.get_file_revision() method.
468
        return [tree.get_file_revision(file_id) for tree in trees]
1185.12.83 by Aaron Bentley
Preliminary weave merge support
469
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
470
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
471
    def check_basis(self, check_clean, require_commits=True):
472
        if self.this_basis is None and require_commits is True:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
473
            raise errors.BzrCommandError(
474
                "This branch has no commits."
475
                " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
476
        if check_clean:
477
            self.compare_basis()
478
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
479
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
480
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
481
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
482
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
483
        try:
484
            basis_tree = self.revision_tree(self.this_tree.last_revision())
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
485
        except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
486
            basis_tree = self.this_tree.basis_tree()
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
487
        if not self.this_tree.has_changes(basis_tree):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
488
            self.this_rev_id = self.this_basis
489
490
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
491
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
492
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
493
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
494
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
495
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
496
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
497
        self._add_parent()
498
499
    def _add_parent(self):
500
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
501
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
502
        operation = cleanup.OperationWithCleanups(
503
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
504
        for revision_id in new_parents:
505
            try:
506
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
507
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
508
                tree = None
509
            else:
510
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
511
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
512
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
513
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
514
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
515
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
516
        """Set the revision and tree to merge from.
517
518
        This sets the other_tree, other_rev_id, other_basis attributes.
519
520
        :param other_revision: The [path, revision] list to merge from.
521
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
522
        self.other_branch, self.other_tree = self._get_tree(other_revision,
523
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
524
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
525
            self.other_rev_id = _mod_revision.ensure_null(
526
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
527
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
528
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
529
            self.other_basis = self.other_rev_id
530
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
531
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
532
            self.other_basis = self.other_rev_id
533
        else:
534
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
535
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
536
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
537
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
538
        if self.other_rev_id is not None:
539
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
540
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
541
2100.3.29 by Aaron Bentley
Get merge working initially
542
    def set_other_revision(self, revision_id, other_branch):
543
        """Set 'other' based on a branch and revision id
544
545
        :param revision_id: The revision to use for a tree
546
        :param other_branch: The branch containing this tree
547
        """
548
        self.other_rev_id = revision_id
549
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
550
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
551
        self.other_tree = self.revision_tree(revision_id)
552
        self.other_basis = revision_id
553
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
554
    def set_base_revision(self, revision_id, branch):
555
        """Set 'base' based on a branch and revision id
556
557
        :param revision_id: The revision to use for a tree
558
        :param branch: The branch containing this tree
559
        """
560
        self.base_rev_id = revision_id
561
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
562
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
563
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
564
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
565
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
566
        if not source.repository.has_same_location(target.repository):
5741.1.9 by Jelmer Vernooij
Remove fetch_tags argument.
567
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
568
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
569
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
570
        revisions = [_mod_revision.ensure_null(self.this_basis),
571
                     _mod_revision.ensure_null(self.other_basis)]
572
        if _mod_revision.NULL_REVISION in revisions:
573
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
574
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
575
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
576
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
577
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
578
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
579
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
580
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
581
            elif len(lcas) == 1:
582
                self.base_rev_id = list(lcas)[0]
583
            else: # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
584
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
585
                if len(lcas) > 2:
586
                    # find_unique_lca can only handle 2 nodes, so we have to
587
                    # start back at the beginning. It is a shame to traverse
588
                    # the graph again, but better than re-implementing
589
                    # find_unique_lca.
590
                    self.base_rev_id = self.revision_graph.find_unique_lca(
591
                                            revisions[0], revisions[1])
592
                else:
593
                    self.base_rev_id = self.revision_graph.find_unique_lca(
594
                                            *lcas)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
595
                sorted_lca_keys = self.revision_graph.find_merge_order(
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
596
                    revisions[0], lcas)
597
                if self.base_rev_id == _mod_revision.NULL_REVISION:
598
                    self.base_rev_id = sorted_lca_keys[0]
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
599
4721.3.1 by Vincent Ladeuil
Cleanup imports.
600
            if self.base_rev_id == _mod_revision.NULL_REVISION:
601
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
602
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
603
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
604
                              ' help criss-cross.')
605
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
606
                if self.base_rev_id in lcas:
607
                    trace.mutter('Unable to find unique lca. '
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
608
                                 'Fallback %r as best option.'
609
                                 % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
610
                interesting_revision_ids = set(lcas)
611
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
612
                interesting_trees = dict((t.get_revision_id(), t)
613
                    for t in self.this_branch.repository.revision_trees(
614
                        interesting_revision_ids))
615
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
616
                if self.base_rev_id in lcas:
617
                    self.base_tree = interesting_trees[self.base_rev_id]
618
                else:
619
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
620
                self._lca_trees = [interesting_trees[key]
621
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
622
            else:
623
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
624
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
625
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
626
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
627
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
628
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
629
        """Set the base revision to use for the merge.
630
631
        :param base_revision: A 2-list containing a path and revision number.
632
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
633
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
634
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
635
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
636
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
637
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
638
            if base_revision[1] == -1:
639
                self.base_rev_id = base_branch.last_revision()
640
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
641
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
642
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
643
                self.base_rev_id = _mod_revision.ensure_null(
644
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
645
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
646
3008.1.8 by Michael Hudson
extract merger creation into a method
647
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
648
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
649
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
650
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
651
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
652
                  'this_branch': self.this_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
653
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
654
        if self.merge_type.requires_base:
655
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
656
        if self.merge_type.supports_reprocess:
657
            kwargs['reprocess'] = self.reprocess
658
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
659
            raise errors.BzrError(
660
                "Conflict reduction is not supported for merge"
661
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
662
        if self.merge_type.supports_show_base:
663
            kwargs['show_base'] = self.show_base
664
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
665
            raise errors.BzrError("Showing base is not supported for this"
666
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
667
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
668
            and not self.base_is_other_ancestor):
669
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
670
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
671
            kwargs['cherrypick'] = (not self.base_is_ancestor or
672
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
673
        if self._is_criss_cross and getattr(self.merge_type,
674
                                            'supports_lca_trees', False):
675
            kwargs['lca_trees'] = self._lca_trees
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
676
        return self.merge_type(pb=None,
3008.1.8 by Michael Hudson
extract merger creation into a method
677
                               change_reporter=self.change_reporter,
678
                               **kwargs)
679
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
680
    def _do_merge_to(self):
681
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
682
        if self.other_branch is not None:
683
            self.other_branch.update_references(self.this_branch)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
684
        merge.do_merge()
685
        if self.recurse == 'down':
686
            for relpath, file_id in self.this_tree.iter_references():
687
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
688
                other_revision = self.other_tree.get_reference_revision(
689
                    file_id, relpath)
690
                if  other_revision == sub_tree.last_revision():
691
                    continue
692
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
693
                sub_merge.merge_type = self.merge_type
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
694
                other_branch = self.other_branch.reference_parent(file_id,
695
                                                                  relpath)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
696
                sub_merge.set_other_revision(other_revision, other_branch)
697
                base_revision = self.base_tree.get_reference_revision(file_id)
698
                sub_merge.base_tree = \
699
                    sub_tree.branch.repository.revision_tree(base_revision)
700
                sub_merge.base_rev_id = base_revision
701
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
702
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
703
3008.1.8 by Michael Hudson
extract merger creation into a method
704
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
705
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
706
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
707
        operation.add_cleanup(self.this_tree.unlock)
708
        if self.base_tree is not None:
709
            self.base_tree.lock_read()
710
            operation.add_cleanup(self.base_tree.unlock)
711
        if self.other_tree is not None:
712
            self.other_tree.lock_read()
713
            operation.add_cleanup(self.other_tree.unlock)
714
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
715
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
716
            if not self.ignore_zero and not trace.is_quiet():
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
717
                trace.note(gettext("All changes applied successfully."))
1534.7.141 by Aaron Bentley
Added conflict reporting
718
        else:
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
719
            trace.note(gettext("%d conflicts encountered.")
4721.3.1 by Vincent Ladeuil
Cleanup imports.
720
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
721
1534.7.134 by Aaron Bentley
Hid raw conflicts
722
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
723
1545.2.4 by Aaron Bentley
PEP8 fixes
724
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
725
class _InventoryNoneEntry(object):
726
    """This represents an inventory entry which *isn't there*.
727
728
    It simplifies the merging logic if we always have an InventoryEntry, even
729
    if it isn't actually present
730
    """
731
    executable = None
732
    kind = None
733
    name = None
734
    parent_id = None
735
    revision = None
736
    symlink_target = None
737
    text_sha1 = None
738
739
_none_entry = _InventoryNoneEntry()
740
741
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
742
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
743
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
744
    requires_base = True
745
    supports_reprocess = True
746
    supports_show_base = True
747
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
748
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
749
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
750
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
751
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
752
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
753
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
754
                 interesting_ids=None, reprocess=False, show_base=False,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
755
                 pb=None, pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
756
                 interesting_files=None, do_merge=True,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
757
                 cherrypick=False, lca_trees=None, this_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
758
        """Initialize the merger object and perform the merge.
759
760
        :param working_tree: The working tree to apply the merge to
761
        :param this_tree: The local tree in the merge operation
762
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
763
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
764
        :param this_branch: The branch associated with this_tree.  Defaults to
765
            this_tree.branch if not supplied.
2590.2.10 by Aaron Bentley
Updates from review
766
        :param interesting_ids: The file_ids of files that should be
767
            participate in the merge.  May not be combined with
768
            interesting_files.
769
        :param: reprocess If True, perform conflict-reduction processing.
770
        :param show_base: If True, show the base revision in text conflicts.
771
            (incompatible with reprocess)
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
772
        :param pb: ignored
2590.2.10 by Aaron Bentley
Updates from review
773
        :param pp: A ProgressPhase object
774
        :param change_reporter: An object that should report changes made
775
        :param interesting_files: The tree-relative paths of files that should
776
            participate in the merge.  If these paths refer to directories,
777
            the contents of those directories will also be included.  May not
778
            be combined with interesting_ids.  If neither interesting_files nor
779
            interesting_ids is specified, all files may participate in the
780
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
781
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
782
            if the ancestry was found to include a criss-cross merge.
783
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
784
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
785
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
786
        if interesting_files is not None and interesting_ids is not None:
787
            raise ValueError(
788
                'specify either interesting_ids or interesting_files')
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
789
        if this_branch is None:
790
            this_branch = this_tree.branch
2590.2.4 by Aaron Bentley
Move entry generation to a helper
791
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
792
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
793
        self.this_tree = working_tree
794
        self.base_tree = base_tree
795
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
796
        self.this_branch = this_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
797
        self._raw_conflicts = []
798
        self.cooked_conflicts = []
799
        self.reprocess = reprocess
800
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
801
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
802
        # Uncommenting this will change the default algorithm to always use
803
        # _entries_lca. This can be useful for running the test suite and
804
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
805
        # if lca_trees is None:
806
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
807
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
808
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
809
        if do_merge:
810
            self.do_merge()
4961.2.12 by Martin Pool
Further pb/pp removals
811
        if pp is not None:
812
            warnings.warn("pp argument to Merge3Merger is deprecated")
813
        if pb is not None:
814
            warnings.warn("pb argument to Merge3Merger is deprecated")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
815
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
816
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
817
        operation = cleanup.OperationWithCleanups(self._do_merge)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
818
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
819
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
820
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
821
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
822
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
823
        operation.add_cleanup(self.other_tree.unlock)
824
        operation.run()
825
826
    def _do_merge(self, operation):
5031.1.2 by Andrew Bennetts
Merge lp:bzr/2.1
827
        self.tt = transform.TreeTransform(self.this_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
828
        operation.add_cleanup(self.tt.finalize)
829
        self._compute_transform()
830
        results = self.tt.apply(no_conflicts=True)
831
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
832
        try:
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
833
            self.this_tree.add_conflicts(self.cooked_conflicts)
834
        except errors.UnsupportedOperation:
835
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
836
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
837
    def make_preview_transform(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
838
        operation = cleanup.OperationWithCleanups(self._make_preview_transform)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
839
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
840
        operation.add_cleanup(self.base_tree.unlock)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
841
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
842
        operation.add_cleanup(self.other_tree.unlock)
843
        return operation.run_simple()
844
845
    def _make_preview_transform(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
846
        self.tt = transform.TransformPreview(self.this_tree)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
847
        self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
848
        return self.tt
849
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
850
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
851
        if self._lca_trees is None:
852
            entries = self._entries3()
853
            resolver = self._three_way
854
        else:
855
            entries = self._entries_lca()
856
            resolver = self._lca_multi_way
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
857
        child_pb = ui.ui_factory.nested_progress_bar()
858
        try:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
859
            factories = Merger.hooks['merge_file_content']
860
            hooks = [factory(self) for factory in factories] + [self]
861
            self.active_hooks = [hook for hook in hooks if hook is not None]
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
862
            for num, (file_id, changed, parents3, names3,
863
                      executable3) in enumerate(entries):
6138.4.1 by Jonathan Riddell
add gettext to progress bar strings
864
                child_pb.update(gettext('Preparing file merge'), num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
865
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
866
                if changed:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
867
                    file_status = self._do_merge_contents(file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
868
                else:
869
                    file_status = 'unmodified'
870
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
871
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
872
        finally:
873
            child_pb.finished()
5993.2.4 by Jelmer Vernooij
Remove feature flag.
874
        self.tt.fixup_new_roots()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
875
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
876
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
877
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
878
        """Finalize the transform and report the changes.
879
880
        This is the second half of _compute_transform.
881
        """
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
882
        child_pb = ui.ui_factory.nested_progress_bar()
883
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
884
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
885
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
886
        finally:
887
            child_pb.finished()
888
        if self.change_reporter is not None:
889
            from bzrlib import delta
890
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
891
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
892
        self.cook_conflicts(fs_conflicts)
893
        for conflict in self.cooked_conflicts:
5898.1.6 by Martin
Avoid implicit str casting in trace methods by calling unicode() on conflict objects first
894
            trace.warning(unicode(conflict))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
895
2590.2.4 by Aaron Bentley
Move entry generation to a helper
896
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
897
        """Gather data about files modified between three trees.
898
899
        Return a list of tuples of file_id, changed, parents3, names3,
900
        executable3.  changed is a boolean indicating whether the file contents
901
        or kind were changed.  parents3 is a tuple of parent ids for base,
902
        other and this.  names3 is a tuple of names for base, other and this.
903
        executable3 is a tuple of execute-bit values for base, other and this.
904
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
905
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
906
        iterator = self.other_tree.iter_changes(self.base_tree,
5783.2.1 by John Arbash Meinel
Remove the 'include_unchanged=True' from iter_changes.
907
                specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
908
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
909
        this_entries = dict((e.file_id, e) for p, e in
910
                            self.this_tree.iter_entries_by_dir(
911
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
912
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
913
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
914
            if (self.interesting_ids is not None and
915
                file_id not in self.interesting_ids):
916
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
917
            entry = this_entries.get(file_id)
918
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
919
                this_name = entry.name
920
                this_parent = entry.parent_id
921
                this_executable = entry.executable
922
            else:
923
                this_name = None
924
                this_parent = None
925
                this_executable = None
926
            parents3 = parents + (this_parent,)
927
            names3 = names + (this_name,)
928
            executable3 = executable + (this_executable,)
929
            result.append((file_id, changed, parents3, names3, executable3))
930
        return result
931
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
932
    def _entries_lca(self):
933
        """Gather data about files modified between multiple trees.
934
935
        This compares OTHER versus all LCA trees, and for interesting entries,
936
        it then compares with THIS and BASE.
937
938
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
939
940
        :return: [(file_id, changed, parents, names, executable)], where:
941
942
            * file_id: Simple file_id of the entry
943
            * changed: Boolean, True if the kind or contents changed else False
944
            * parents: ((base, [parent_id, in, lcas]), parent_id_other,
945
                        parent_id_this)
946
            * names:   ((base, [name, in, lcas]), name_in_other, name_in_this)
947
            * executable: ((base, [exec, in, lcas]), exec_in_other,
948
                        exec_in_this)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
949
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
950
        if self.interesting_files is not None:
951
            lookup_trees = [self.this_tree, self.base_tree]
952
            lookup_trees.extend(self._lca_trees)
953
            # I think we should include the lca trees as well
954
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
955
                                                        lookup_trees)
956
        else:
957
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
958
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
959
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
960
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
961
        base_inventory = self.base_tree.inventory
962
        this_inventory = self.this_tree.inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
963
        for path, file_id, other_ie, lca_values in walker.iter_all():
964
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
965
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
966
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
967
            if interesting_ids is not None and file_id not in interesting_ids:
968
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
969
3514.4.30 by John Arbash Meinel
Several updates.
970
            # If other_revision is found in any of the lcas, that means this
971
            # node is uninteresting. This is because when merging, if there are
972
            # multiple heads(), we have to create a new node. So if we didn't,
973
            # we know that the ancestry is linear, and that OTHER did not
974
            # modify anything
975
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
976
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
977
            if other_revision is not None:
978
                # We can't use this shortcut when other_revision is None,
979
                # because it may be None because things are WorkingTrees, and
980
                # not because it is *actually* None.
981
                is_unmodified = False
982
                for lca_path, ie in lca_values:
983
                    if ie is not None and ie.revision == other_revision:
984
                        is_unmodified = True
985
                        break
986
                if is_unmodified:
987
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
988
989
            lca_entries = []
990
            for lca_path, lca_ie in lca_values:
991
                if lca_ie is None:
992
                    lca_entries.append(_none_entry)
993
                else:
994
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
995
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
996
            if base_inventory.has_id(file_id):
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
997
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
998
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
999
                base_ie = _none_entry
1000
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
1001
            if this_inventory.has_id(file_id):
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
1002
                this_ie = this_inventory[file_id]
1003
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1004
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
1005
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1006
            lca_kinds = []
1007
            lca_parent_ids = []
1008
            lca_names = []
1009
            lca_executable = []
1010
            for lca_ie in lca_entries:
1011
                lca_kinds.append(lca_ie.kind)
1012
                lca_parent_ids.append(lca_ie.parent_id)
1013
                lca_names.append(lca_ie.name)
1014
                lca_executable.append(lca_ie.executable)
1015
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1016
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1017
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1018
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1019
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1020
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1021
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1022
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1023
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1024
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1025
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1026
            content_changed = True
1027
            if kind_winner == 'this':
1028
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1029
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1030
                    if parent_id_winner == 'this' and name_winner == 'this':
1031
                        # No change for this directory in OTHER, skip
1032
                        continue
1033
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1034
                elif other_ie.kind is None or other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1035
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1036
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1037
                            return None
1038
                        return tree.get_file_sha1(file_id)
1039
                    base_sha1 = get_sha1(base_ie, self.base_tree)
1040
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
1041
                                 in zip(lca_entries, self._lca_trees)]
1042
                    this_sha1 = get_sha1(this_ie, self.this_tree)
1043
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1044
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1045
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1046
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1047
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1048
                        (base_ie.executable, lca_executable),
1049
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1050
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1051
                        and sha1_winner == 'this' and exec_winner == 'this'):
1052
                        # No kind, parent, name, exec, or content change for
1053
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1054
                        continue
1055
                    if sha1_winner == 'this':
1056
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1057
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1058
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1059
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1060
                            return None
1061
                        return tree.get_symlink_target(file_id)
1062
                    base_target = get_target(base_ie, self.base_tree)
1063
                    lca_targets = [get_target(ie, tree) for ie, tree
1064
                                   in zip(lca_entries, self._lca_trees)]
1065
                    this_target = get_target(this_ie, self.this_tree)
1066
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1067
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1068
                        (base_target, lca_targets),
1069
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1070
                    if (parent_id_winner == 'this' and name_winner == 'this'
1071
                        and target_winner == 'this'):
1072
                        # No kind, parent, name, or symlink target change
1073
                        # not interesting
1074
                        continue
1075
                    if target_winner == 'this':
1076
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1077
                elif other_ie.kind == 'tree-reference':
1078
                    # The 'changed' information seems to be handled at a higher
1079
                    # level. At least, _entries3 returns False for content
1080
                    # changed, even when at a new revision_id.
1081
                    content_changed = False
1082
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1083
                        # Nothing interesting
1084
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1085
                else:
1086
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1087
1088
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1089
            result.append((file_id, content_changed,
1090
                           ((base_ie.parent_id, lca_parent_ids),
1091
                            other_ie.parent_id, this_ie.parent_id),
1092
                           ((base_ie.name, lca_names),
1093
                            other_ie.name, this_ie.name),
1094
                           ((base_ie.executable, lca_executable),
1095
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1096
                          ))
1097
        return result
1098
5954.4.3 by Aaron Bentley
Mark fix_root as deprecated.
1099
    @deprecated_method(deprecated_in((2, 4, 0)))
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1100
    def fix_root(self):
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1101
        if self.tt.final_kind(self.tt.root) is None:
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1102
            self.tt.cancel_deletion(self.tt.root)
1103
        if self.tt.final_file_id(self.tt.root) is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1104
            self.tt.version_file(self.tt.tree_file_id(self.tt.root),
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1105
                                 self.tt.root)
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
1106
        other_root_file_id = self.other_tree.get_root_id()
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
1107
        if other_root_file_id is None:
1108
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1109
        other_root = self.tt.trans_id_file_id(other_root_file_id)
1110
        if other_root == self.tt.root:
1111
            return
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
1112
        if self.this_tree.inventory.has_id(
1113
            self.other_tree.inventory.root.file_id):
1114
            # the other tree's root is a non-root in the current tree (as
1115
            # when a previously unrelated branch is merged into another)
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
1116
            return
4597.9.9 by Vincent Ladeuil
Fix wrong conflict resolution (thanks to test coverage...).
1117
        if self.tt.final_kind(other_root) is not None:
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1118
            other_root_is_present = True
4597.9.8 by Vincent Ladeuil
Merge bzr.dev into cleanup
1119
        else:
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1120
            # other_root doesn't have a physical representation. We still need
1121
            # to move any references to the actual root of the tree.
1122
            other_root_is_present = False
1123
        # 'other_tree.inventory.root' is not present in this tree. We are
1124
        # calling adjust_path for children which *want* to be present with a
1125
        # correct place to go.
5783.2.1 by John Arbash Meinel
Remove the 'include_unchanged=True' from iter_changes.
1126
        for _, child in self.other_tree.inventory.root.children.iteritems():
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1127
            trans_id = self.tt.trans_id_file_id(child.file_id)
1128
            if not other_root_is_present:
4597.9.8 by Vincent Ladeuil
Merge bzr.dev into cleanup
1129
                if self.tt.final_kind(trans_id) is not None:
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1130
                    # The item exist in the final tree and has a defined place
1131
                    # to go already.
1132
                    continue
1133
            # Move the item into the root
5783.2.2 by John Arbash Meinel
Handle when a file doesn't exist anymore.
1134
            try:
1135
                final_name = self.tt.final_name(trans_id)
1136
            except errors.NoFinalPath:
1137
                # This file is not present anymore, ignore it.
1138
                continue
1139
            self.tt.adjust_path(final_name, self.tt.root, trans_id)
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1140
        if other_root_is_present:
4634.149.3 by Vincent Ladeuil
Fix bug #3735898 by filtering out garbage paths.
1141
            self.tt.cancel_creation(other_root)
1142
            self.tt.cancel_versioning(other_root)
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1143
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1144
    def write_modified(self, results):
1145
        modified_hashes = {}
1146
        for path in results.modified_paths:
1147
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
1148
            if file_id is None:
1149
                continue
1150
            hash = self.this_tree.get_file_sha1(file_id)
1151
            if hash is None:
1152
                continue
1153
            modified_hashes[file_id] = hash
1154
        self.this_tree.set_merge_modified(modified_hashes)
1155
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1156
    @staticmethod
1157
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1158
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1159
        if entry is None:
1160
            return None
1161
        return entry.parent_id
1162
1163
    @staticmethod
1164
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1165
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1166
        if entry is None:
1167
            return None
1168
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1169
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1170
    @staticmethod
1171
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1172
        """Determine the sha1 of the file contents (used as a key method)."""
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
1173
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1174
            return None
1175
        return tree.get_file_sha1(file_id)
1176
1177
    @staticmethod
1178
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1179
        """Determine the executability of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1180
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1181
            return None
1182
        if tree.kind(file_id) != "file":
1183
            return False
1184
        return tree.is_executable(file_id)
1185
1186
    @staticmethod
1187
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1188
        """Determine the kind of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1189
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1190
            return None
1191
        return tree.kind(file_id)
1192
1193
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1194
    def _three_way(base, other, this):
1195
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1196
            # if 'base == other', either they all agree, or only 'this' has
1197
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1198
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1199
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1200
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1201
            return 'conflict'
1202
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1203
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1204
            return "this"
1205
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1206
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1207
            return "other"
1208
1209
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1210
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1211
        """Consider LCAs when determining whether a change has occurred.
1212
1213
        If LCAS are all identical, this is the same as a _three_way comparison.
1214
1215
        :param bases: value in (BASE, [LCAS])
1216
        :param other: value in OTHER
1217
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1218
        :param allow_overriding_lca: If there is more than one unique lca
1219
            value, allow OTHER to override THIS if it has a new value, and
1220
            THIS only has an lca value, or vice versa. This is appropriate for
1221
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1222
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1223
            changed or not.
1224
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1225
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1226
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1227
        if other == this:
1228
            # Either Ambiguously clean, or nothing was actually changed. We
1229
            # don't really care
1230
            return 'this'
1231
        base_val, lca_vals = bases
1232
        # Remove 'base_val' from the lca_vals, because it is not interesting
1233
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1234
                                      if lca_val != base_val]
1235
        if len(filtered_lca_vals) == 0:
1236
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1237
1238
        unique_lca_vals = set(filtered_lca_vals)
1239
        if len(unique_lca_vals) == 1:
1240
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1241
1242
        if allow_overriding_lca:
1243
            if other in unique_lca_vals:
1244
                if this in unique_lca_vals:
1245
                    # Each side picked a different lca, conflict
1246
                    return 'conflict'
1247
                else:
1248
                    # This has a value which supersedes both lca values, and
1249
                    # other only has an lca value
1250
                    return 'this'
1251
            elif this in unique_lca_vals:
1252
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1253
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1254
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1255
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1256
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1257
        return 'conflict'
1258
1259
    @staticmethod
5077.2.1 by Vincent Ladeuil
Deprecate Merge3Merger.scalar_three_way.
1260
    @deprecated_method(deprecated_in((2, 2, 0)))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1261
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
1262
        """Do a three-way test on a scalar.
1263
        Return "this", "other" or "conflict", depending whether a value wins.
1264
        """
1265
        key_base = key(base_tree, file_id)
1266
        key_other = key(other_tree, file_id)
1267
        #if base == other, either they all agree, or only THIS has changed.
1268
        if key_base == key_other:
1269
            return "this"
1270
        key_this = key(this_tree, file_id)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1271
        # "Ambiguous clean merge"
1272
        if key_this == key_other:
1273
            return "this"
1274
        elif key_this == key_base:
1275
            return "other"
1276
        else:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1277
            return "conflict"
1278
1279
    def merge_names(self, file_id):
1280
        def get_entry(tree):
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1281
            if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1282
                return tree.inventory[file_id]
1283
            else:
1284
                return None
1285
        this_entry = get_entry(self.this_tree)
1286
        other_entry = get_entry(self.other_tree)
1287
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1288
        entries = (base_entry, other_entry, this_entry)
1289
        names = []
1290
        parents = []
1291
        for entry in entries:
1292
            if entry is None:
1293
                names.append(None)
1294
                parents.append(None)
1295
            else:
1296
                names.append(entry.name)
1297
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1298
        return self._merge_names(file_id, parents, names,
1299
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1300
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1301
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1302
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1303
        base_name, other_name, this_name = names
1304
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1305
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1306
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1307
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1308
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1309
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1310
            if name_winner == "this":
1311
                name_winner = "other"
1312
            if parent_id_winner == "this":
1313
                parent_id_winner = "other"
1314
        if name_winner == "this" and parent_id_winner == "this":
1315
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1316
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1317
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1318
            # road if a ContentConflict needs to be created so we should not do
1319
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1320
            trans_id = self.tt.trans_id_file_id(file_id)
1321
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1322
                                        this_parent, this_name,
1323
                                        other_parent, other_name))
5954.4.2 by Aaron Bentley
Support merging into null tree.
1324
        if not self.other_tree.has_id(file_id):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1325
            # it doesn't matter whether the result was 'other' or
5954.4.6 by Aaron Bentley
Updates from review.
1326
            # 'conflict'-- if it has no file id, we leave it alone.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1327
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1328
        parent_id = parents[self.winner_idx[parent_id_winner]]
5954.4.2 by Aaron Bentley
Support merging into null tree.
1329
        name = names[self.winner_idx[name_winner]]
1330
        if parent_id is not None or name is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1331
            # if we get here, name_winner and parent_winner are set to safe
1332
            # values.
5954.4.2 by Aaron Bentley
Support merging into null tree.
1333
            if parent_id is None and name is not None:
1334
                # if parent_id is None and name is non-None, current file is
1335
                # the tree root.
1336
                if names[self.winner_idx[parent_id_winner]] != '':
1337
                    raise AssertionError(
1338
                        'File looks like a root, but named %s' %
1339
                        names[self.winner_idx[parent_id_winner]])
1340
                parent_trans_id = transform.ROOT_PARENT
1341
            else:
1342
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1343
            self.tt.adjust_path(name, parent_trans_id,
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1344
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1345
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1346
    def _do_merge_contents(self, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1347
        """Performs a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1348
        def contents_pair(tree):
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
1349
            if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1350
                return (None, None)
1351
            kind = tree.kind(file_id)
1352
            if kind == "file":
1353
                contents = tree.get_file_sha1(file_id)
1354
            elif kind == "symlink":
1355
                contents = tree.get_symlink_target(file_id)
1356
            else:
1357
                contents = None
1358
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1359
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1360
        # See SPOT run.  run, SPOT, run.
1361
        # So we're not QUITE repeating ourselves; we do tricky things with
1362
        # file kind...
1363
        base_pair = contents_pair(self.base_tree)
1364
        other_pair = contents_pair(self.other_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1365
        if self._lca_trees:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1366
            this_pair = contents_pair(self.this_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1367
            lca_pairs = [contents_pair(tree) for tree in self._lca_trees]
1368
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1369
                                         this_pair, allow_overriding_lca=False)
1370
        else:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1371
            if base_pair == other_pair:
1372
                winner = 'this'
1373
            else:
1374
                # We delayed evaluating this_pair as long as we can to avoid
1375
                # unnecessary sha1 calculation
1376
                this_pair = contents_pair(self.this_tree)
1377
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1378
        if winner == 'this':
1379
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1380
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1381
        # We have a hypothetical conflict, but if we have files, then we
1382
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1383
        trans_id = self.tt.trans_id_file_id(file_id)
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1384
        params = MergeHookParams(self, file_id, trans_id, this_pair[0],
1385
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1386
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1387
        hook_status = 'not_applicable'
1388
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1389
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1390
            if hook_status != 'not_applicable':
1391
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1392
                break
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1393
        # If the merge ends up replacing the content of the file, we get rid of
1394
        # it at the end of this method (this variable is used to track the
1395
        # exceptions to this rule).
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1396
        keep_this = False
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1397
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1398
        if hook_status == 'not_applicable':
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1399
            # No merge hook was able to resolve the situation. Two cases exist:
1400
            # a content conflict or a duplicate one.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1401
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1402
            name = self.tt.final_name(trans_id)
1403
            parent_id = self.tt.final_parent(trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1404
            duplicate = False
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1405
            inhibit_content_conflict = False
1406
            if params.this_kind is None: # file_id is not in THIS
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1407
                # Is the name used for a different file_id ?
1408
                dupe_path = self.other_tree.id2path(file_id)
1409
                this_id = self.this_tree.path2id(dupe_path)
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1410
                if this_id is not None:
1411
                    # Two entries for the same path
1412
                    keep_this = True
1413
                    # versioning the merged file will trigger a duplicate
1414
                    # conflict
1415
                    self.tt.version_file(file_id, trans_id)
1416
                    transform.create_from_tree(
1417
                        self.tt, trans_id, self.other_tree, file_id,
1418
                        filter_tree_path=self._get_filter_tree_path(file_id))
1419
                    inhibit_content_conflict = True
1420
            elif params.other_kind is None: # file_id is not in OTHER
1421
                # Is the name used for a different file_id ?
1422
                dupe_path = self.this_tree.id2path(file_id)
1423
                other_id = self.other_tree.path2id(dupe_path)
1424
                if other_id is not None:
1425
                    # Two entries for the same path again, but here, the other
1426
                    # entry will also be merged.  We simply inhibit the
1427
                    # 'content' conflict creation because we know OTHER will
1428
                    # create (or has already created depending on ordering) an
1429
                    # entry at the same path. This will trigger a 'duplicate'
1430
                    # conflict later.
1431
                    keep_this = True
1432
                    inhibit_content_conflict = True
1433
            if not inhibit_content_conflict:
1434
                if params.this_kind is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1435
                    self.tt.unversion_file(trans_id)
1436
                # This is a contents conflict, because none of the available
1437
                # functions could merge it.
1438
                file_group = self._dump_conflicts(name, parent_id, file_id,
1439
                                                  set_version=True)
1440
                self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1441
        elif hook_status == 'success':
1442
            self.tt.create_file(lines, trans_id)
1443
        elif hook_status == 'conflicted':
1444
            # XXX: perhaps the hook should be able to provide
1445
            # the BASE/THIS/OTHER files?
1446
            self.tt.create_file(lines, trans_id)
1447
            self._raw_conflicts.append(('text conflict', trans_id))
1448
            name = self.tt.final_name(trans_id)
1449
            parent_id = self.tt.final_parent(trans_id)
4869.3.23 by Andrew Bennetts
Remove some confusing code that has no effect.
1450
            self._dump_conflicts(name, parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1451
        elif hook_status == 'delete':
1452
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1453
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1454
        elif hook_status == 'done':
1455
            # The hook function did whatever it needs to do directly, no
1456
            # further action needed here.
1457
            pass
1458
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1459
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1460
        if not self.this_tree.has_id(file_id) and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1461
            self.tt.version_file(file_id, trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1462
        if not keep_this:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1463
            # The merge has been performed and produced a new content, so the
1464
            # old contents should not be retained.
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1465
            self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1466
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1467
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1468
    def _default_other_winner_merge(self, merge_hook_params):
1469
        """Replace this contents with other."""
1470
        file_id = merge_hook_params.file_id
1471
        trans_id = merge_hook_params.trans_id
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1472
        if self.other_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1473
            # OTHER changed the file
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1474
            transform.create_from_tree(
1475
                self.tt, trans_id, self.other_tree, file_id,
1476
                filter_tree_path=self._get_filter_tree_path(file_id))
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1477
            return 'done', None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1478
        elif self.this_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1479
            # OTHER deleted the file
1480
            return 'delete', None
1481
        else:
1482
            raise AssertionError(
1483
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1484
                % (file_id,))
1485
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1486
    def merge_contents(self, merge_hook_params):
1487
        """Fallback merge logic after user installed hooks."""
1488
        # This function is used in merge hooks as the fallback instance.
1489
        # Perhaps making this function and the functions it calls be a 
1490
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1491
        if merge_hook_params.winner == 'other':
1492
            # OTHER is a straight winner, so replace this contents with other
1493
            return self._default_other_winner_merge(merge_hook_params)
1494
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1495
            # THIS and OTHER are both files, so text merge.  Either
1496
            # BASE is a file, or both converted to files, so at least we
1497
            # have agreement that output should be a file.
1498
            try:
1499
                self.text_merge(merge_hook_params.file_id,
1500
                    merge_hook_params.trans_id)
1501
            except errors.BinaryFile:
1502
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1503
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1504
        else:
1505
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1506
1507
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1508
        """Return the lines in a file, or an empty list."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1509
        if tree.has_id(file_id):
4708.2.1 by Martin
Ensure all files opened by bazaar proper are explicitly closed
1510
            return tree.get_file_lines(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1511
        else:
1512
            return []
1513
1514
    def text_merge(self, file_id, trans_id):
1515
        """Perform a three-way text merge on a file_id"""
1516
        # it's possible that we got here with base as a different type.
1517
        # if so, we just want two-way text conflicts.
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1518
        if self.base_tree.has_id(file_id) and \
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1519
            self.base_tree.kind(file_id) == "file":
1520
            base_lines = self.get_lines(self.base_tree, file_id)
1521
        else:
1522
            base_lines = []
1523
        other_lines = self.get_lines(self.other_tree, file_id)
1524
        this_lines = self.get_lines(self.this_tree, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1525
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1526
                           is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1527
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1528
        if self.show_base is True:
1529
            base_marker = '|' * 7
1530
        else:
1531
            base_marker = None
1532
1533
        def iter_merge3(retval):
1534
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1535
            for line in m3.merge_lines(name_a = "TREE",
1536
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1537
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1538
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1539
                                       base_marker=base_marker,
1540
                                       reprocess=self.reprocess):
1541
                if line.startswith(start_marker):
1542
                    retval["text_conflicts"] = True
1543
                    yield line.replace(start_marker, '<' * 7)
1544
                else:
1545
                    yield line
1546
        retval = {}
1547
        merge3_iterator = iter_merge3(retval)
1548
        self.tt.create_file(merge3_iterator, trans_id)
1549
        if retval["text_conflicts"] is True:
1550
            self._raw_conflicts.append(('text conflict', trans_id))
1551
            name = self.tt.final_name(trans_id)
1552
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1553
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1554
                                              this_lines, base_lines,
1555
                                              other_lines)
1556
            file_group.append(trans_id)
1557
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1558
1559
    def _get_filter_tree_path(self, file_id):
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1560
        if self.this_tree.supports_content_filtering():
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1561
            # We get the path from the working tree if it exists.
1562
            # That fails though when OTHER is adding a file, so
1563
            # we fall back to the other tree to find the path if
1564
            # it doesn't exist locally.
1565
            try:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1566
                return self.this_tree.id2path(file_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1567
            except errors.NoSuchId:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1568
                return self.other_tree.id2path(file_id)
1569
        # Skip the id2path lookup for older formats
1570
        return None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1571
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1572
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1573
                        base_lines=None, other_lines=None, set_version=False,
1574
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1575
        """Emit conflict files.
1576
        If this_lines, base_lines, or other_lines are omitted, they will be
1577
        determined automatically.  If set_version is true, the .OTHER, .THIS
1578
        or .BASE (in that order) will be created as versioned files.
1579
        """
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1580
        data = [('OTHER', self.other_tree, other_lines),
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1581
                ('THIS', self.this_tree, this_lines)]
1582
        if not no_base:
1583
            data.append(('BASE', self.base_tree, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1584
1585
        # We need to use the actual path in the working tree of the file here,
1586
        # ignoring the conflict suffixes
1587
        wt = self.this_tree
1588
        if wt.supports_content_filtering():
1589
            try:
1590
                filter_tree_path = wt.id2path(file_id)
1591
            except errors.NoSuchId:
1592
                # file has been deleted
1593
                filter_tree_path = None
1594
        else:
1595
            # Skip the id2path lookup for older formats
1596
            filter_tree_path = None
1597
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1598
        versioned = False
1599
        file_group = []
1600
        for suffix, tree, lines in data:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1601
            if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1602
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1603
                                               suffix, lines, filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1604
                file_group.append(trans_id)
1605
                if set_version and not versioned:
1606
                    self.tt.version_file(file_id, trans_id)
1607
                    versioned = True
1608
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1609
3363.17.21 by Aaron Bentley
Conflicts are handled when merging from preview trees
1610
    def _conflict_file(self, name, parent_id, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1611
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1612
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1613
        name = name + '.' + suffix
1614
        trans_id = self.tt.create_path(name, parent_id)
4854.1.1 by Andrew Bennetts
Merge lp:bzr/2.0 into lp:bzr.
1615
        transform.create_from_tree(self.tt, trans_id, tree, file_id, lines,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1616
            filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1617
        return trans_id
1618
1619
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1620
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1621
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1622
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1623
        self._merge_executable(file_id, executable, file_status,
1624
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1625
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1626
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1627
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1628
        """Perform a merge on the execute bit."""
1629
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1630
        if file_status == "deleted":
1631
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1632
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1633
        if winner == "conflict":
1634
        # There must be a None in here, if we have a conflict, but we
1635
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1636
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1637
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1638
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1639
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1640
        if winner == 'this' and file_status != "modified":
1641
            return
1642
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1643
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1644
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1645
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1646
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1647
        else:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1648
            if self.other_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1649
                executability = other_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1650
            elif self.this_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1651
                executability = this_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1652
            elif self.base_tree_has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1653
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1654
        if executability is not None:
1655
            trans_id = self.tt.trans_id_file_id(file_id)
1656
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1657
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1658
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1659
        """Convert all conflicts into a form that doesn't depend on trans_id"""
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1660
        content_conflict_file_ids = set()
1661
        cooked_conflicts = transform.cook_conflicts(fs_conflicts, self.tt)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1662
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1663
        for conflict in self._raw_conflicts:
1664
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1665
            if conflict_type == 'path conflict':
1666
                (trans_id, file_id,
1667
                this_parent, this_name,
1668
                other_parent, other_name) = conflict[1:]
1669
                if this_parent is None or this_name is None:
1670
                    this_path = '<deleted>'
1671
                else:
1672
                    parent_path =  fp.get_path(
1673
                        self.tt.trans_id_file_id(this_parent))
1674
                    this_path = osutils.pathjoin(parent_path, this_name)
1675
                if other_parent is None or other_name is None:
1676
                    other_path = '<deleted>'
1677
                else:
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1678
                    if other_parent == self.other_tree.get_root_id():
5050.73.9 by Vincent Ladeuil
Fix typo.
1679
                        # The tree transform doesn't know about the other root,
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1680
                        # so we special case here to avoid a NoFinalPath
1681
                        # exception
1682
                        parent_path = ''
1683
                    else:
1684
                        parent_path =  fp.get_path(
1685
                            self.tt.trans_id_file_id(other_parent))
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1686
                    other_path = osutils.pathjoin(parent_path, other_name)
1687
                c = _mod_conflicts.Conflict.factory(
1688
                    'path conflict', path=this_path,
1689
                    conflict_path=other_path,
1690
                    file_id=file_id)
1691
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1692
                for trans_id in conflict[1]:
1693
                    file_id = self.tt.final_file_id(trans_id)
1694
                    if file_id is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1695
                        # Ok we found the relevant file-id
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1696
                        break
1697
                path = fp.get_path(trans_id)
1698
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1699
                    if path.endswith(suffix):
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1700
                        # Here is the raw path
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1701
                        path = path[:-len(suffix)]
1702
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1703
                c = _mod_conflicts.Conflict.factory(conflict_type,
1704
                                                    path=path, file_id=file_id)
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1705
                content_conflict_file_ids.add(file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1706
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1707
                trans_id = conflict[1]
1708
                path = fp.get_path(trans_id)
1709
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1710
                c = _mod_conflicts.Conflict.factory(conflict_type,
1711
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1712
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1713
                raise AssertionError('bad conflict type: %r' % (conflict,))
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1714
            cooked_conflicts.append(c)
5988.2.2 by Vincent Ladeuil
Make it clear that we start from an empty cooked_conflicts list.
1715
1716
        self.cooked_conflicts = []
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1717
        # We want to get rid of path conflicts when a corresponding contents
1718
        # conflict exists. This can occur when one branch deletes a file while
1719
        # the other renames *and* modifies it. In this case, the content
1720
        # conflict is enough.
1721
        for c in cooked_conflicts:
1722
            if (c.typestring == 'path conflict'
1723
                and c.file_id in content_conflict_file_ids):
1724
                continue
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1725
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1726
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1727
1728
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1729
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1730
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1731
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1732
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1733
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1734
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1735
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1736
    def _generate_merge_plan(self, file_id, base):
1737
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1738
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1739
1740
    def _merged_lines(self, file_id):
1741
        """Generate the merged lines.
1742
        There is no distinction between lines that are meant to contain <<<<<<<
1743
        and conflicts.
1744
        """
1745
        if self.cherrypick:
1746
            base = self.base_tree
1747
        else:
1748
            base = None
1749
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1750
        if 'merge' in debug.debug_flags:
1751
            plan = list(plan)
1752
            trans_id = self.tt.trans_id_file_id(file_id)
1753
            name = self.tt.final_name(trans_id) + '.plan'
4634.101.6 by John Arbash Meinel
killed-both and killed-base is 11 chars long.
1754
            contents = ('%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1755
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1756
        textmerge = versionedfile.PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1757
                                                 '>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1758
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1759
        if conflicts:
1760
            base_lines = textmerge.base_from_plan()
1761
        else:
1762
            base_lines = None
1763
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1764
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1765
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1766
        """Perform a (weave) text merge for a given file and file-id.
1767
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1768
        and a conflict will be noted.
1769
        """
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1770
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1771
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1772
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1773
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1774
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1775
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1776
        if base_lines is not None:
1777
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1778
            self._raw_conflicts.append(('text conflict', trans_id))
1779
            name = self.tt.final_name(trans_id)
1780
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1781
            file_group = self._dump_conflicts(name, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1782
                                              no_base=False,
1783
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1784
            file_group.append(trans_id)
1785
1786
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1787
class LCAMerger(WeaveMerger):
1788
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1789
    def _generate_merge_plan(self, file_id, base):
1790
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1791
                                                  base=base)
1792
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1793
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1794
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1795
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1796
    def dump_file(self, temp_dir, name, tree, file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1797
        out_path = osutils.pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1798
        out_file = open(out_path, "wb")
1799
        try:
1800
            in_file = tree.get_file(file_id)
1801
            for line in in_file:
1802
                out_file.write(line)
1803
        finally:
1804
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1805
        return out_path
1806
1807
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1808
        """Perform a diff3 merge using a specified file-id and trans-id.
1809
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1810
        will be dumped, and a will be conflict noted.
1811
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1812
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1813
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1814
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1815
            new_file = osutils.pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1816
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1817
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1818
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1819
            status = bzrlib.patch.diff3(new_file, this, base, other)
1820
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1821
                raise errors.BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1822
            f = open(new_file, 'rb')
1823
            try:
1824
                self.tt.create_file(f, trans_id)
1825
            finally:
1826
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1827
            if status == 1:
1828
                name = self.tt.final_name(trans_id)
1829
                parent_id = self.tt.final_parent(trans_id)
1830
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1831
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1832
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1833
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1834
1835
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1836
class PathNotInTree(errors.BzrError):
1837
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1838
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1839
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1840
    def __init__(self, path, tree):
1841
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1842
1843
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1844
class MergeIntoMerger(Merger):
1845
    """Merger that understands other_tree will be merged into a subdir.
1846
1847
    This also changes the Merger api so that it uses real Branch, revision_id,
1848
    and RevisonTree objects, rather than using revision specs.
1849
    """
1850
1851
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
5246.2.22 by Andrew Bennetts
Minor tweaks.
1852
            source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1853
        """Create a new MergeIntoMerger object.
1854
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1855
        source_subpath in other_tree will be effectively copied to
1856
        target_subdir in this_tree.
1857
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1858
        :param this_tree: The tree that we will be merging into.
1859
        :param other_branch: The Branch we will be merging from.
1860
        :param other_tree: The RevisionTree object we want to merge.
1861
        :param target_subdir: The relative path where we want to merge
1862
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1863
        :param source_subpath: The relative path specifying the subtree of
1864
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1865
        """
1866
        # It is assumed that we are merging a tree that is not in our current
1867
        # ancestry, which means we are using the "EmptyTree" as our basis.
1868
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
1869
                                _mod_revision.NULL_REVISION)
1870
        super(MergeIntoMerger, self).__init__(
1871
            this_branch=this_tree.branch,
1872
            this_tree=this_tree,
1873
            other_tree=other_tree,
1874
            base_tree=null_ancestor_tree,
1875
            )
1876
        self._target_subdir = target_subdir
1877
        self._source_subpath = source_subpath
1878
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1879
        if other_rev_id is None:
1880
            other_rev_id = other_tree.get_revision_id()
1881
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1882
        self.base_is_ancestor = True
1883
        self.backup_files = True
1884
        self.merge_type = Merge3Merger
1885
        self.show_base = False
1886
        self.reprocess = False
1887
        self.interesting_ids = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1888
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
1889
              target_subdir=self._target_subdir,
1890
              source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1891
        if self._source_subpath != '':
1892
            # If this isn't a partial merge make sure the revisions will be
1893
            # present.
1894
            self._maybe_fetch(self.other_branch, self.this_branch,
1895
                self.other_basis)
1896
1897
    def set_pending(self):
1898
        if self._source_subpath != '':
1899
            return
1900
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1901
1902
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1903
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1904
    """Wrap a merge-type class to provide extra parameters.
1905
    
1906
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1907
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1908
    the 'merge_type' member.  It is difficult override do_merge without
1909
    re-writing the whole thing, so instead we create a wrapper which will pass
1910
    the extra parameters.
1911
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1912
1913
    def __init__(self, merge_type, **kwargs):
1914
        self._extra_kwargs = kwargs
1915
        self._merge_type = merge_type
1916
1917
    def __call__(self, *args, **kwargs):
1918
        kwargs.update(self._extra_kwargs)
1919
        return self._merge_type(*args, **kwargs)
1920
1921
    def __getattr__(self, name):
1922
        return getattr(self._merge_type, name)
1923
1924
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1925
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1926
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1927
1928
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1929
        """Initialize the merger object.
1930
1931
        :param args: See Merge3Merger.__init__'s args.
1932
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1933
            source_subpath and target_subdir.
1934
        :keyword source_subpath: The relative path specifying the subtree of
1935
            other_tree to merge into this_tree.
1936
        :keyword target_subdir: The relative path where we want to merge
1937
            other_tree into this_tree
1938
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1939
        # All of the interesting work happens during Merge3Merger.__init__(),
1940
        # so we have have to hack in to get our extra parameters set.
1941
        self._source_subpath = kwargs.pop('source_subpath')
1942
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1943
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1944
1945
    def _compute_transform(self):
1946
        child_pb = ui.ui_factory.nested_progress_bar()
1947
        try:
1948
            entries = self._entries_to_incorporate()
1949
            entries = list(entries)
1950
            for num, (entry, parent_id) in enumerate(entries):
6138.4.1 by Jonathan Riddell
add gettext to progress bar strings
1951
                child_pb.update(gettext('Preparing file merge'), num, len(entries))
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1952
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1953
                trans_id = transform.new_by_entry(self.tt, entry,
1954
                    parent_trans_id, self.other_tree)
1955
        finally:
1956
            child_pb.finished()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1957
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1958
1959
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1960
        """Yields pairs of (inventory_entry, new_parent)."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1961
        other_inv = self.other_tree.inventory
1962
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1963
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1964
            # XXX: The error would be clearer if it gave the URL of the source
1965
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1966
            raise PathNotInTree(self._source_subpath, "Source tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1967
        subdir = other_inv[subdir_id]
1968
        parent_in_target = osutils.dirname(self._target_subdir)
1969
        target_id = self.this_tree.inventory.path2id(parent_in_target)
1970
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1971
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1972
        name_in_target = osutils.basename(self._target_subdir)
1973
        merge_into_root = subdir.copy()
1974
        merge_into_root.name = name_in_target
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
1975
        if self.this_tree.inventory.has_id(merge_into_root.file_id):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1976
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1977
            # This can happen fairly easily if the directory we are
1978
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1979
            # their root_id.  Users will expect this to Just Work, so we
1980
            # change the file-id here.
1981
            # Non-root file-ids could potentially conflict too.  That's really
1982
            # an edge case, so we don't do anything special for those.  We let
1983
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1984
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1985
        yield (merge_into_root, target_id)
5246.2.10 by Andrew Bennetts
Add more tests.
1986
        if subdir.kind != 'directory':
1987
            # No children, so we are done.
1988
            return
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1989
        for ignored_path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1990
            parent_id = entry.parent_id
1991
            if parent_id == subdir.file_id:
1992
                # The root's parent ID has changed, so make sure children of
1993
                # the root refer to the new ID.
1994
                parent_id = merge_into_root.file_id
1995
            yield (entry, parent_id)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1996
1997
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1998
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1999
                backup_files=False,
2000
                merge_type=Merge3Merger,
2001
                interesting_ids=None,
2002
                show_base=False,
2003
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
2004
                other_rev_id=None,
2005
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
2006
                this_tree=None,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
2007
                pb=None,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
2008
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2009
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
2010
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
2011
    Typical use is probably::
2012
2013
        merge_inner(branch, branch.get_revision_tree(other_revision),
2014
                    branch.get_revision_tree(base_revision))
2015
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
2016
    if this_tree is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2017
        raise errors.BzrError("bzrlib.merge.merge_inner requires a this_tree "
5993.2.1 by Jelmer Vernooij
Add test for rootless tree merge.
2018
                              "parameter")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
2019
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
2020
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
2021
    merger.backup_files = backup_files
2022
    merger.merge_type = merge_type
2023
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
2024
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
2025
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
2026
        if interesting_ids:
2027
            raise ValueError('Only supply interesting_ids'
2028
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
2029
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
2030
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
2031
    merger.reprocess = reprocess
2032
    merger.other_rev_id = other_rev_id
2033
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
2034
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
2035
    if get_revision_id is None:
2036
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
2037
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
2038
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
2039
    return merger.do_merge()
2040
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
2041
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
2042
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
2043
2044
    This method provides a sanctioned way to retrieve it.
2045
    """
2046
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
2047
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
2048
2049
2050
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
2051
    def status_a(revision, text):
2052
        if revision in ancestors_b:
2053
            return 'killed-b', text
2054
        else:
2055
            return 'new-a', text
2056
2057
    def status_b(revision, text):
2058
        if revision in ancestors_a:
2059
            return 'killed-a', text
2060
        else:
2061
            return 'new-b', text
2062
2063
    plain_a = [t for (a, t) in annotated_a]
2064
    plain_b = [t for (a, t) in annotated_b]
2065
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
2066
    blocks = matcher.get_matching_blocks()
2067
    a_cur = 0
2068
    b_cur = 0
2069
    for ai, bi, l in blocks:
2070
        # process all mismatched sections
2071
        # (last mismatched section is handled because blocks always
2072
        # includes a 0-length last block)
2073
        for revision, text in annotated_a[a_cur:ai]:
2074
            yield status_a(revision, text)
2075
        for revision, text in annotated_b[b_cur:bi]:
2076
            yield status_b(revision, text)
2077
        # and now the matched section
2078
        a_cur = ai + l
2079
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
2080
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
2081
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2082
2083
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2084
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2085
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2086
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2087
        """Contructor.
2088
2089
        :param a_rev: Revision-id of one revision to merge
2090
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2091
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2092
        :param key_prefix: A prefix for accessing keys in vf, typically
2093
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2094
        """
2095
        self.a_rev = a_rev
2096
        self.b_rev = b_rev
2097
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2098
        self._last_lines = None
2099
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2100
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2101
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2102
        self._precache_tip_lines()
2103
2104
    def _precache_tip_lines(self):
2105
        lines = self.get_lines([self.a_rev, self.b_rev])
2106
        self.lines_a = lines[self.a_rev]
2107
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2108
2109
    def get_lines(self, revisions):
2110
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2111
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2112
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2113
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2114
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2115
        result = {}
2116
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2117
            if record.storage_kind == 'absent':
2118
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2119
            result[record.key[-1]] = osutils.chunks_to_lines(
2120
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2121
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2122
2123
    def plan_merge(self):
2124
        """Generate a 'plan' for merging the two revisions.
2125
2126
        This involves comparing their texts and determining the cause of
2127
        differences.  If text A has a line and text B does not, then either the
2128
        line was added to text A, or it was deleted from B.  Once the causes
2129
        are combined, they are written out in the format described in
2130
        VersionedFile.plan_merge
2131
        """
2132
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2133
        unique_a, unique_b = self._unique_lines(blocks)
2134
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2135
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2136
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2137
2138
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2139
        last_i = 0
2140
        last_j = 0
2141
        for i, j, n in blocks:
2142
            for a_index in range(last_i, i):
2143
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2144
                    if a_index in killed_b:
2145
                        yield 'conflicted-a', self.lines_a[a_index]
2146
                    else:
2147
                        yield 'new-a', self.lines_a[a_index]
2148
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2149
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2150
            for b_index in range(last_j, j):
2151
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2152
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2153
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2154
                    else:
2155
                        yield 'new-b', self.lines_b[b_index]
2156
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2157
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2158
            # handle common lines
2159
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2160
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2161
            last_i = i+n
2162
            last_j = j+n
2163
2164
    def _get_matching_blocks(self, left_revision, right_revision):
2165
        """Return a description of which sections of two revisions match.
2166
2167
        See SequenceMatcher.get_matching_blocks
2168
        """
3144.3.7 by Aaron Bentley
Update from review
2169
        cached = self._cached_matching_blocks.get((left_revision,
2170
                                                   right_revision))
2171
        if cached is not None:
2172
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2173
        if self._last_lines_revision_id == left_revision:
2174
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2175
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2176
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2177
            lines = self.get_lines([left_revision, right_revision])
2178
            left_lines = lines[left_revision]
2179
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2180
        self._last_lines = right_lines
2181
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2182
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2183
                                                       right_lines)
2184
        return matcher.get_matching_blocks()
2185
2186
    def _unique_lines(self, matching_blocks):
2187
        """Analyse matching_blocks to determine which lines are unique
2188
2189
        :return: a tuple of (unique_left, unique_right), where the values are
2190
            sets of line numbers of unique lines.
2191
        """
2192
        last_i = 0
2193
        last_j = 0
2194
        unique_left = []
2195
        unique_right = []
2196
        for i, j, n in matching_blocks:
2197
            unique_left.extend(range(last_i, i))
2198
            unique_right.extend(range(last_j, j))
2199
            last_i = i + n
2200
            last_j = j + n
2201
        return unique_left, unique_right
2202
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2203
    @staticmethod
2204
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2205
        """Remove changes from new_plan that came from old_plan.
2206
2207
        It is assumed that the difference between the old_plan and new_plan
2208
        is their choice of 'b' text.
2209
2210
        All lines from new_plan that differ from old_plan are emitted
2211
        verbatim.  All lines from new_plan that match old_plan but are
2212
        not about the 'b' revision are emitted verbatim.
2213
2214
        Lines that match and are about the 'b' revision are the lines we
2215
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2216
        is skipped entirely.
2217
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2218
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2219
                                                       new_plan)
2220
        last_j = 0
2221
        for i, j, n in matcher.get_matching_blocks():
2222
            for jj in range(last_j, j):
2223
                yield new_plan[jj]
2224
            for jj in range(j, j+n):
2225
                plan_line = new_plan[jj]
2226
                if plan_line[0] == 'new-b':
2227
                    pass
2228
                elif plan_line[0] == 'killed-b':
2229
                    yield 'unchanged', plan_line[1]
2230
                else:
2231
                    yield plan_line
2232
            last_j = j + n
2233
2234
2235
class _PlanMerge(_PlanMergeBase):
2236
    """Plan an annotate merge using on-the-fly annotation"""
2237
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2238
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2239
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2240
        self.a_key = self._key_prefix + (self.a_rev,)
2241
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2242
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2243
        heads = self.graph.heads((self.a_key, self.b_key))
2244
        if len(heads) == 1:
2245
            # one side dominates, so we can just return its values, yay for
2246
            # per-file graphs
2247
            # Ideally we would know that before we get this far
2248
            self._head_key = heads.pop()
2249
            if self._head_key == self.a_key:
2250
                other = b_rev
2251
            else:
2252
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2253
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2254
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2255
            self._weave = None
2256
        else:
2257
            self._head_key = None
2258
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2259
2260
    def _precache_tip_lines(self):
2261
        # Turn this into a no-op, because we will do this later
2262
        pass
2263
2264
    def _find_recursive_lcas(self):
2265
        """Find all the ancestors back to a unique lca"""
2266
        cur_ancestors = (self.a_key, self.b_key)
2267
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2268
        # rather than a key tuple. We will just map that directly to no common
2269
        # ancestors.
2270
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2271
        while True:
2272
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2273
            # Map a plain NULL_REVISION to a simple no-ancestors
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2274
            if next_lcas == set([_mod_revision.NULL_REVISION]):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2275
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2276
            # Order the lca's based on when they were merged into the tip
2277
            # While the actual merge portion of weave merge uses a set() of
2278
            # active revisions, the order of insertion *does* effect the
2279
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2280
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2281
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2282
                                                                    next_lcas))
2283
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2284
            if len(next_lcas) == 0:
2285
                break
2286
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2287
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2288
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2289
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2290
                # More than 2 lca's, fall back to grabbing all nodes between
2291
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2292
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2293
                             ' %s, %s\n=> %s',
2294
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2295
                cur_lcas = next_lcas
2296
                while len(cur_lcas) > 1:
2297
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2298
                if len(cur_lcas) == 0:
2299
                    # No common base to find, use the full ancestry
2300
                    unique_lca = None
2301
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2302
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2303
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2304
                        # find_lca will return a plain 'NULL_REVISION' rather
2305
                        # than a key tuple when there is no common ancestor, we
2306
                        # prefer to just use None, because it doesn't confuse
2307
                        # _get_interesting_texts()
2308
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2309
                parent_map.update(self._find_unique_parents(next_lcas,
2310
                                                            unique_lca))
2311
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2312
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2313
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2314
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2315
    def _find_unique_parents(self, tip_keys, base_key):
2316
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2317
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2318
        :param tip_keys: Nodes that are interesting
2319
        :param base_key: Cull all ancestors of this node
2320
        :return: The parent map for all revisions between tip_keys and
2321
            base_key. base_key will be included. References to nodes outside of
2322
            the ancestor set will also be removed.
2323
        """
2324
        # TODO: this would be simpler if find_unique_ancestors took a list
2325
        #       instead of a single tip, internally it supports it, but it
2326
        #       isn't a "backwards compatible" api change.
2327
        if base_key is None:
2328
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2329
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2330
            # thus confuses things like _get_interesting_texts, and our logic
2331
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2332
            if _mod_revision.NULL_REVISION in parent_map:
2333
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2334
        else:
2335
            interesting = set()
2336
            for tip in tip_keys:
2337
                interesting.update(
2338
                    self.graph.find_unique_ancestors(tip, [base_key]))
2339
            parent_map = self.graph.get_parent_map(interesting)
2340
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2341
        culled_parent_map, child_map, tails = self._remove_external_references(
2342
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2343
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2344
        if base_key is not None:
2345
            tails.remove(base_key)
2346
            self._prune_tails(culled_parent_map, child_map, tails)
2347
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2348
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2349
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2350
2351
    @staticmethod
2352
    def _remove_external_references(parent_map):
2353
        """Remove references that go outside of the parent map.
2354
2355
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2356
        :return: (filtered_parent_map, child_map, tails)
2357
            filtered_parent_map is parent_map without external references
2358
            child_map is the {parent_key: [child_keys]} mapping
2359
            tails is a list of nodes that do not have any parents in the map
2360
        """
2361
        # TODO: The basic effect of this function seems more generic than
2362
        #       _PlanMerge. But the specific details of building a child_map,
2363
        #       and computing tails seems very specific to _PlanMerge.
2364
        #       Still, should this be in Graph land?
2365
        filtered_parent_map = {}
2366
        child_map = {}
2367
        tails = []
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2368
        for key, parent_keys in parent_map.iteritems():
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2369
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2370
            if not culled_parent_keys:
2371
                tails.append(key)
2372
            for parent_key in culled_parent_keys:
2373
                child_map.setdefault(parent_key, []).append(key)
2374
            # TODO: Do we want to do this, it adds overhead for every node,
2375
            #       just to say that the node has no children
2376
            child_map.setdefault(key, [])
2377
            filtered_parent_map[key] = culled_parent_keys
2378
        return filtered_parent_map, child_map, tails
2379
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2380
    @staticmethod
2381
    def _prune_tails(parent_map, child_map, tails_to_remove):
2382
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2383
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2384
        This will remove the supplied revisions until no more children have 0
2385
        parents.
2386
2387
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2388
            be modified in place.
2389
        :param tails_to_remove: A list of tips that should be removed,
2390
            this list will be consumed
2391
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2392
            this dict will be modified
2393
        :return: None, parent_map will be modified in place.
2394
        """
2395
        while tails_to_remove:
2396
            next = tails_to_remove.pop()
2397
            parent_map.pop(next)
2398
            children = child_map.pop(next)
2399
            for child in children:
2400
                child_parents = parent_map[child]
2401
                child_parents.remove(next)
2402
                if len(child_parents) == 0:
2403
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2404
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2405
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2406
        """Return a dict of texts we are interested in.
2407
2408
        Note that the input is in key tuples, but the output is in plain
2409
        revision ids.
2410
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2411
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2412
        :return: A dict of {'revision_id':lines} as returned by
2413
            _PlanMergeBase.get_lines()
2414
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2415
        all_revision_keys = set(parent_map)
2416
        all_revision_keys.add(self.a_key)
2417
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2418
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2419
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2420
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2421
        return all_texts
2422
2423
    def _build_weave(self):
2424
        from bzrlib import weave
2425
        self._weave = weave.Weave(weave_name='in_memory_weave',
2426
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2427
        parent_map = self._find_recursive_lcas()
2428
2429
        all_texts = self._get_interesting_texts(parent_map)
2430
2431
        # Note: Unfortunately, the order given by topo_sort will effect the
2432
        # ordering resolution in the output. Specifically, if you add A then B,
2433
        # then in the output text A lines will show up before B lines. And, of
2434
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2435
        # So we use merge_sort, and add a fake node on the tip.
2436
        # This ensures that left-hand parents will always be inserted into the
2437
        # weave before right-hand parents.
2438
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2439
        parent_map[tip_key] = (self.a_key, self.b_key)
2440
2441
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2442
                                                                  tip_key)):
2443
            if key == tip_key:
2444
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2445
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2446
            parent_keys = parent_map[key]
2447
            revision_id = key[-1]
2448
            parent_ids = [k[-1] for k in parent_keys]
2449
            self._weave.add_lines(revision_id, parent_ids,
2450
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2451
2452
    def plan_merge(self):
2453
        """Generate a 'plan' for merging the two revisions.
2454
2455
        This involves comparing their texts and determining the cause of
2456
        differences.  If text A has a line and text B does not, then either the
2457
        line was added to text A, or it was deleted from B.  Once the causes
2458
        are combined, they are written out in the format described in
2459
        VersionedFile.plan_merge
2460
        """
2461
        if self._head_key is not None: # There was a single head
2462
            if self._head_key == self.a_key:
2463
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2464
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2465
                if self._head_key != self.b_key:
2466
                    raise AssertionError('There was an invalid head: %s != %s'
2467
                                         % (self.b_key, self._head_key))
2468
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2469
            head_rev = self._head_key[-1]
2470
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2471
            return ((plan, line) for line in lines)
2472
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2473
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2474
2475
class _PlanLCAMerge(_PlanMergeBase):
2476
    """
3144.3.7 by Aaron Bentley
Update from review
2477
    This merge algorithm differs from _PlanMerge in that:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2478
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2479
    1. comparisons are done against LCAs only
2480
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2481
       another are marked as conflicts, by emitting the line as conflicted-a
2482
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2483
2484
    This is faster, and hopefully produces more useful output.
2485
    """
2486
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2487
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2488
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2489
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2490
        self.lcas = set()
2491
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2492
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2493
                self.lcas.add(lca)
2494
            else:
2495
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2496
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2497
            if _mod_revision.is_null(lca):
2498
                lca_lines = []
2499
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2500
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2501
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2502
                                                           lca_lines)
2503
            blocks = list(matcher.get_matching_blocks())
2504
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2505
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2506
                                                           lca_lines)
2507
            blocks = list(matcher.get_matching_blocks())
2508
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2509
3144.3.7 by Aaron Bentley
Update from review
2510
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2511
        """Determines the status unique lines versus all lcas.
2512
2513
        Basically, determines why the line is unique to this revision.
2514
2515
        A line may be determined new, killed, or both.
2516
3144.3.7 by Aaron Bentley
Update from review
2517
        If a line is determined new, that means it was not present in at least
2518
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2519
2520
        If a line is determined killed, that means the line was present in
2521
        at least one LCA.
2522
2523
        If a line is killed and new, this indicates that the two merge
2524
        revisions contain differing conflict resolutions.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2525
3144.3.7 by Aaron Bentley
Update from review
2526
        :param revision_id: The id of the revision in which the lines are
2527
            unique
2528
        :param unique_line_numbers: The line numbers of unique lines.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2529
        :return: a tuple of (new_this, killed_other)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2530
        """
2531
        new = set()
2532
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2533
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2534
        for lca in self.lcas:
2535
            blocks = self._get_matching_blocks(revision_id, lca)
2536
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2537
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2538
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2539
        return new, killed