/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
6379.6.1 by Jelmer Vernooij
Import absolute_import in a few places.
17
from __future__ import absolute_import
18
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
19
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
20
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
21
from .lazy_import import lazy_import
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
22
lazy_import(globals(), """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
23
from breezy import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
25
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
26
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
27
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
28
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
29
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
30
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
31
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
32
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
33
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
34
    textfile,
35
    trace,
36
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
37
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
38
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
39
    ui,
6670.4.3 by Jelmer Vernooij
Fix more imports.
40
    workingtree,
41
    )
42
from breezy.bzr import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
43
    versionedfile,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
44
    )
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
45
from breezy.i18n import gettext
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
46
""")
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
47
from . import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
48
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
49
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
50
    hooks,
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
51
    registry,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
52
    )
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
53
from .sixish import (
54
    viewitems,
55
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
56
# TODO: Report back as changes are merged in
57
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
58
1185.35.4 by Aaron Bentley
Implemented remerge
59
def transform_tree(from_tree, to_tree, interesting_ids=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
60
    from_tree.lock_tree_write()
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
61
    operation = cleanup.OperationWithCleanups(merge_inner)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
62
    operation.add_cleanup(from_tree.unlock)
63
    operation.run_simple(from_tree.branch, to_tree, from_tree,
64
        ignore_zero=True, interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
65
1457.1.12 by Robert Collins
Update comment to reflect author.
66
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
67
class MergeHooks(hooks.Hooks):
68
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
69
    def __init__(self):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
70
        hooks.Hooks.__init__(self, "breezy.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
71
        self.add_hook('merge_file_content',
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
72
            "Called with a breezy.merge.Merger object to create a per file "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
73
            "merge object when starting a merge. "
74
            "Should return either None or a subclass of "
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
75
            "``breezy.merge.AbstractPerFileMerger``. "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
76
            "Such objects will then be called per file "
77
            "that needs to be merged (including when one "
78
            "side has deleted the file and the other has changed it). "
79
            "See the AbstractPerFileMerger API docs for details on how it is "
80
            "used by merge.",
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
81
            (2, 1))
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
82
        self.add_hook('pre_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
83
            'Called before a merge. '
84
            'Receives a Merger object as the single argument.',
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
85
            (2, 5))
86
        self.add_hook('post_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
87
            'Called after a merge. '
88
            'Receives a Merger object as the single argument. '
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
89
            'The return value is ignored.',
90
            (2, 5))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
91
92
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
93
class AbstractPerFileMerger(object):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
94
    """PerFileMerger objects are used by plugins extending merge for breezy.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
95
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
96
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
97
    
98
    :ivar merger: The Merge3Merger performing the merge.
99
    """
100
101
    def __init__(self, merger):
102
        """Create a PerFileMerger for use with merger."""
103
        self.merger = merger
104
105
    def merge_contents(self, merge_params):
106
        """Attempt to merge the contents of a single file.
107
        
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
108
        :param merge_params: A breezy.merge.MergeFileHookParams
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
109
        :return: A tuple of (status, chunks), where status is one of
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
110
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
111
            is 'success' or 'conflicted', then chunks should be an iterable of
112
            strings for the new file contents.
113
        """
114
        return ('not applicable', None)
115
116
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
117
class PerFileMerger(AbstractPerFileMerger):
118
    """Merge individual files when self.file_matches returns True.
119
120
    This class is intended to be subclassed.  The file_matches and
121
    merge_matching methods should be overridden with concrete implementations.
122
    """
123
124
    def file_matches(self, params):
125
        """Return True if merge_matching should be called on this file.
126
127
        Only called with merges of plain files with no clear winner.
128
129
        Subclasses must override this.
130
        """
131
        raise NotImplementedError(self.file_matches)
132
133
    def get_filename(self, params, tree):
134
        """Lookup the filename (i.e. basename, not path), given a Tree (e.g.
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
135
        self.merger.this_tree) and a MergeFileHookParams.
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
136
        """
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
137
        return osutils.basename(tree.id2path(params.file_id))
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
138
139
    def get_filepath(self, params, tree):
140
        """Calculate the path to the file in a tree.
141
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
142
        :param params: A MergeFileHookParams describing the file to merge
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
143
        :param tree: a Tree, e.g. self.merger.this_tree.
144
        """
145
        return tree.id2path(params.file_id)
146
147
    def merge_contents(self, params):
148
        """Merge the contents of a single file."""
149
        # Check whether this custom merge logic should be used.
150
        if (
151
            # OTHER is a straight winner, rely on default merge.
152
            params.winner == 'other' or
153
            # THIS and OTHER aren't both files.
154
            not params.is_file_merge() or
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
155
            # The filename doesn't match
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
156
            not self.file_matches(params)):
157
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
158
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
159
160
    def merge_matching(self, params):
161
        """Merge the contents of a single file that has matched the criteria
162
        in PerFileMerger.merge_contents (is a conflict, is a file,
163
        self.file_matches is True).
164
165
        Subclasses must override this.
166
        """
167
        raise NotImplementedError(self.merge_matching)
168
169
170
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
171
    """Merge individual files when configured via a .conf file.
172
173
    This is a base class for concrete custom file merging logic. Concrete
174
    classes should implement ``merge_text``.
175
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
176
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
177
    
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
178
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
179
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
180
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
181
        details. <name_prefix>_merge_files describes the files targeted by the
182
        hook for example.
183
        
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
184
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
185
        is present.
186
    """
187
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
188
    name_prefix = None
189
    default_files = None
190
191
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
192
        super(ConfigurableFileMerger, self).__init__(merger)
193
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
194
        self.default_files = self.__class__.default_files or []
195
        self.name_prefix = self.__class__.name_prefix
196
        if self.name_prefix is None:
197
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
198
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
199
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
200
        """Check whether the file should call the merge hook.
201
202
        <name_prefix>_merge_files configuration variable is a list of files
203
        that should use the hook.
204
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
205
        affected_files = self.affected_files
206
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
207
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
208
            # Until bzr provides a better policy for caching the config, we
209
            # just add the part we're interested in to the params to avoid
6740.1.1 by Jelmer Vernooij
Rename bazaar.conf to breezy.conf.
210
            # reading the config files repeatedly (breezy.conf, location.conf,
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
211
            # branch.conf).
212
            config_key = self.name_prefix + '_merge_files'
213
            affected_files = config.get_user_option_as_list(config_key)
214
            if affected_files is None:
215
                # If nothing was specified in the config, use the default.
216
                affected_files = self.default_files
217
            self.affected_files = affected_files
218
        if affected_files:
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
219
            filepath = self.get_filepath(params, self.merger.this_tree)
220
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
221
                return True
222
        return False
223
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
224
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
225
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
226
227
    def merge_text(self, params):
228
        """Merge the byte contents of a single file.
229
230
        This is called after checking that the merge should be performed in
231
        merge_contents, and it should behave as per
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
232
        ``breezy.merge.AbstractPerFileMerger.merge_contents``.
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
233
        """
234
        raise NotImplementedError(self.merge_text)
235
236
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
237
class MergeFileHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
238
    """Object holding parameters passed to merge_file_content hooks.
239
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
240
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
241
242
    :ivar file_id: the file ID of the file being merged
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
243
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
244
    :ivar this_kind: kind of file_id in 'this' tree
245
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
246
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
247
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
248
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
249
    def __init__(self, merger, file_id, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
250
            winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
251
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
252
        self.file_id = file_id
253
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
254
        self.this_kind = this_kind
255
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
256
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
257
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
258
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
259
        """True if this_kind and other_kind are both 'file'."""
260
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
261
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
262
    @decorators.cachedproperty
263
    def base_lines(self):
264
        """The lines of the 'base' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
265
        return self._merger.get_lines(self._merger.base_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
266
267
    @decorators.cachedproperty
268
    def this_lines(self):
269
        """The lines of the 'this' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
270
        return self._merger.get_lines(self._merger.this_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
271
272
    @decorators.cachedproperty
273
    def other_lines(self):
274
        """The lines of the 'other' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
275
        return self._merger.get_lines(self._merger.other_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
276
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
277
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
278
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
279
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
280
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
281
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
282
    def __init__(self, this_branch, other_tree=None, base_tree=None,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
283
                 this_tree=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
284
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
285
        object.__init__(self)
286
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
287
        self.this_basis = _mod_revision.ensure_null(
288
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
289
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
290
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
291
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
292
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
293
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
294
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
295
        self.base_tree = base_tree
296
        self.ignore_zero = False
297
        self.backup_files = False
298
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
299
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
300
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
301
        self.reprocess = False
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
302
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
303
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
304
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
305
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
306
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
307
        self._base_is_ancestor = None
308
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
309
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
310
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
311
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
312
    def cache_trees_with_revision_ids(self, trees):
313
        """Cache any tree in trees if it has a revision_id."""
314
        for maybe_tree in trees:
315
            if maybe_tree is None:
316
                continue
317
            try:
318
                rev_id = maybe_tree.get_revision_id()
319
            except AttributeError:
320
                continue
321
            self._cached_trees[rev_id] = maybe_tree
322
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
323
    @property
324
    def revision_graph(self):
325
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
326
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
327
        return self._revision_graph
328
329
    def _set_base_is_ancestor(self, value):
330
        self._base_is_ancestor = value
331
332
    def _get_base_is_ancestor(self):
333
        if self._base_is_ancestor is None:
334
            self._base_is_ancestor = self.revision_graph.is_ancestor(
335
                self.base_rev_id, self.this_basis)
336
        return self._base_is_ancestor
337
338
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
339
340
    def _set_base_is_other_ancestor(self, value):
341
        self._base_is_other_ancestor = value
342
343
    def _get_base_is_other_ancestor(self):
344
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
345
            if self.other_basis is None:
346
                return True
347
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
348
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
349
        return self._base_is_other_ancestor
350
351
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
352
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
353
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
354
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
355
    def from_uncommitted(tree, other_tree, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
356
        """Return a Merger for uncommitted changes in other_tree.
357
358
        :param tree: The tree to merge into
359
        :param other_tree: The tree to get uncommitted changes from
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
360
        :param base_tree: The basis to use for the merge.  If unspecified,
361
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
362
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
363
        if base_tree is None:
364
            base_tree = other_tree.basis_tree()
6719.1.2 by Jelmer Vernooij
Fix some tests.
365
        merger = Merger(tree.branch, other_tree, base_tree, tree)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
366
        merger.base_rev_id = merger.base_tree.get_revision_id()
367
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
368
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
369
        return merger
370
371
    @classmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
372
    def from_mergeable(klass, tree, mergeable):
1551.15.74 by Aaron Bentley
Textual updates from review
373
        """Return a Merger for a bundle or merge directive.
374
375
        :param tree: The tree to merge changes into
376
        :param mergeable: A merge directive or bundle
377
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
378
        mergeable.install_revisions(tree.branch.repository)
379
        base_revision_id, other_revision_id, verified =\
380
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
381
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
382
        if base_revision_id is not None:
383
            if (base_revision_id != _mod_revision.NULL_REVISION and
384
                revision_graph.is_ancestor(
385
                base_revision_id, tree.branch.last_revision())):
386
                base_revision_id = None
387
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
388
                trace.warning('Performing cherrypick')
6719.1.2 by Jelmer Vernooij
Fix some tests.
389
        merger = klass.from_revision_ids(tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
390
                                         base_revision_id, revision_graph=
391
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
392
        return merger, verified
393
394
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
395
    def from_revision_ids(tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
396
                          base_branch=None, revision_graph=None,
397
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
398
        """Return a Merger for revision-ids.
399
400
        :param tree: The tree to merge changes into
401
        :param other: The revision-id to use as OTHER
402
        :param base: The revision-id to use as BASE.  If not specified, will
403
            be auto-selected.
404
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
405
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
406
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
407
            not supplied, other_branch or tree.branch will be used.
408
        :param revision_graph: If you have a revision_graph precomputed, pass
409
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
410
        :param tree_branch: The branch associated with tree.  If not supplied,
411
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
412
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
413
        if tree_branch is None:
414
            tree_branch = tree.branch
6719.1.2 by Jelmer Vernooij
Fix some tests.
415
        merger = Merger(tree_branch, this_tree=tree,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
416
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
417
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
418
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
419
        merger.set_other_revision(other, other_branch)
420
        if base is None:
421
            merger.find_base()
422
        else:
423
            if base_branch is None:
424
                base_branch = other_branch
425
            merger.set_base_revision(base, base_branch)
426
        return merger
427
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
428
    def revision_tree(self, revision_id, branch=None):
429
        if revision_id not in self._cached_trees:
430
            if branch is None:
431
                branch = self.this_branch
432
            try:
433
                tree = self.this_tree.revision_tree(revision_id)
434
            except errors.NoSuchRevisionInTree:
435
                tree = branch.repository.revision_tree(revision_id)
436
            self._cached_trees[revision_id] = tree
437
        return self._cached_trees[revision_id]
438
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
439
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
440
        location, revno = treespec
441
        if revno is None:
442
            tree = workingtree.WorkingTree.open_containing(location)[0]
443
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
444
        branch = _mod_branch.Branch.open_containing(
445
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
446
        if revno == -1:
447
            revision_id = branch.last_revision()
448
        else:
449
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
450
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
451
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
452
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
453
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
454
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
455
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
456
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
457
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
458
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
459
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
460
        self._add_parent()
461
462
    def _add_parent(self):
463
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
464
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
465
        operation = cleanup.OperationWithCleanups(
466
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
467
        for revision_id in new_parents:
468
            try:
469
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
470
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
471
                tree = None
472
            else:
473
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
474
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
475
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
476
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
477
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
478
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
479
        """Set the revision and tree to merge from.
480
481
        This sets the other_tree, other_rev_id, other_basis attributes.
482
483
        :param other_revision: The [path, revision] list to merge from.
484
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
485
        self.other_branch, self.other_tree = self._get_tree(other_revision,
486
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
487
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
488
            self.other_rev_id = _mod_revision.ensure_null(
489
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
490
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
491
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
492
            self.other_basis = self.other_rev_id
493
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
494
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
495
            self.other_basis = self.other_rev_id
496
        else:
497
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
498
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
499
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
500
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
501
        if self.other_rev_id is not None:
502
            self._cached_trees[self.other_rev_id] = self.other_tree
6388.1.2 by Jelmer Vernooij
Fix formatting.
503
        self._maybe_fetch(self.other_branch, self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
504
2100.3.29 by Aaron Bentley
Get merge working initially
505
    def set_other_revision(self, revision_id, other_branch):
506
        """Set 'other' based on a branch and revision id
507
508
        :param revision_id: The revision to use for a tree
509
        :param other_branch: The branch containing this tree
510
        """
511
        self.other_rev_id = revision_id
512
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
513
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
514
        self.other_tree = self.revision_tree(revision_id)
515
        self.other_basis = revision_id
516
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
517
    def set_base_revision(self, revision_id, branch):
518
        """Set 'base' based on a branch and revision id
519
520
        :param revision_id: The revision to use for a tree
521
        :param branch: The branch containing this tree
522
        """
523
        self.base_rev_id = revision_id
524
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
525
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
526
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
527
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
528
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
529
        if not source.repository.has_same_location(target.repository):
5741.1.9 by Jelmer Vernooij
Remove fetch_tags argument.
530
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
531
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
532
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
533
        revisions = [_mod_revision.ensure_null(self.this_basis),
534
                     _mod_revision.ensure_null(self.other_basis)]
535
        if _mod_revision.NULL_REVISION in revisions:
536
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
537
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
538
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
539
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
540
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
541
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
542
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
543
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
544
            elif len(lcas) == 1:
545
                self.base_rev_id = list(lcas)[0]
546
            else: # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
547
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
548
                if len(lcas) > 2:
549
                    # find_unique_lca can only handle 2 nodes, so we have to
550
                    # start back at the beginning. It is a shame to traverse
551
                    # the graph again, but better than re-implementing
552
                    # find_unique_lca.
553
                    self.base_rev_id = self.revision_graph.find_unique_lca(
554
                                            revisions[0], revisions[1])
555
                else:
556
                    self.base_rev_id = self.revision_graph.find_unique_lca(
557
                                            *lcas)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
558
                sorted_lca_keys = self.revision_graph.find_merge_order(
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
559
                    revisions[0], lcas)
560
                if self.base_rev_id == _mod_revision.NULL_REVISION:
561
                    self.base_rev_id = sorted_lca_keys[0]
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
562
4721.3.1 by Vincent Ladeuil
Cleanup imports.
563
            if self.base_rev_id == _mod_revision.NULL_REVISION:
564
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
565
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
566
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
567
                              ' help criss-cross.')
568
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
569
                if self.base_rev_id in lcas:
570
                    trace.mutter('Unable to find unique lca. '
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
571
                                 'Fallback %r as best option.'
572
                                 % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
573
                interesting_revision_ids = set(lcas)
574
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
575
                interesting_trees = dict((t.get_revision_id(), t)
576
                    for t in self.this_branch.repository.revision_trees(
577
                        interesting_revision_ids))
578
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
579
                if self.base_rev_id in lcas:
580
                    self.base_tree = interesting_trees[self.base_rev_id]
581
                else:
582
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
583
                self._lca_trees = [interesting_trees[key]
584
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
585
            else:
586
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
587
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
588
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
589
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
590
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
591
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
592
        """Set the base revision to use for the merge.
593
594
        :param base_revision: A 2-list containing a path and revision number.
595
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
596
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
597
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
598
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
599
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
600
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
601
            if base_revision[1] == -1:
602
                self.base_rev_id = base_branch.last_revision()
603
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
604
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
605
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
606
                self.base_rev_id = _mod_revision.ensure_null(
607
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
608
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
609
3008.1.8 by Michael Hudson
extract merger creation into a method
610
    def make_merger(self):
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
611
        kwargs = {'working_tree': self.this_tree, 'this_tree': self.this_tree,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
612
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
613
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
614
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
615
                  'this_branch': self.this_branch,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
616
                  'other_branch': self.other_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
617
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
618
        if self.merge_type.requires_base:
619
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
620
        if self.merge_type.supports_reprocess:
621
            kwargs['reprocess'] = self.reprocess
622
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
623
            raise errors.BzrError(
624
                "Conflict reduction is not supported for merge"
625
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
626
        if self.merge_type.supports_show_base:
627
            kwargs['show_base'] = self.show_base
628
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
629
            raise errors.BzrError("Showing base is not supported for this"
630
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
631
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
632
            and not self.base_is_other_ancestor):
633
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
634
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
635
            kwargs['cherrypick'] = (not self.base_is_ancestor or
636
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
637
        if self._is_criss_cross and getattr(self.merge_type,
638
                                            'supports_lca_trees', False):
639
            kwargs['lca_trees'] = self._lca_trees
6719.1.2 by Jelmer Vernooij
Fix some tests.
640
        return self.merge_type(change_reporter=self.change_reporter,
3008.1.8 by Michael Hudson
extract merger creation into a method
641
                               **kwargs)
642
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
643
    def _do_merge_to(self):
644
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
645
        if self.other_branch is not None:
646
            self.other_branch.update_references(self.this_branch)
6388.1.4 by Jelmer Vernooij
Fix tests.
647
        for hook in Merger.hooks['pre_merge']:
648
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
649
        merge.do_merge()
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
650
        for hook in Merger.hooks['post_merge']:
651
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
652
        if self.recurse == 'down':
653
            for relpath, file_id in self.this_tree.iter_references():
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
654
                sub_tree = self.this_tree.get_nested_tree(relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
655
                other_revision = self.other_tree.get_reference_revision(
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
656
                    relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
657
                if  other_revision == sub_tree.last_revision():
658
                    continue
659
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
660
                sub_merge.merge_type = self.merge_type
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
661
                other_branch = self.other_branch.reference_parent(file_id,
662
                                                                  relpath)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
663
                sub_merge.set_other_revision(other_revision, other_branch)
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
664
                base_tree_path = self.base_tree.id2path(file_id)
665
                base_revision = self.base_tree.get_reference_revision(
666
                    base_tree_path, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
667
                sub_merge.base_tree = \
668
                    sub_tree.branch.repository.revision_tree(base_revision)
669
                sub_merge.base_rev_id = base_revision
670
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
671
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
672
3008.1.8 by Michael Hudson
extract merger creation into a method
673
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
674
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
675
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
676
        operation.add_cleanup(self.this_tree.unlock)
677
        if self.base_tree is not None:
678
            self.base_tree.lock_read()
679
            operation.add_cleanup(self.base_tree.unlock)
680
        if self.other_tree is not None:
681
            self.other_tree.lock_read()
682
            operation.add_cleanup(self.other_tree.unlock)
683
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
684
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
685
            if not self.ignore_zero and not trace.is_quiet():
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
686
                trace.note(gettext("All changes applied successfully."))
1534.7.141 by Aaron Bentley
Added conflict reporting
687
        else:
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
688
            trace.note(gettext("%d conflicts encountered.")
4721.3.1 by Vincent Ladeuil
Cleanup imports.
689
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
690
1534.7.134 by Aaron Bentley
Hid raw conflicts
691
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
692
1545.2.4 by Aaron Bentley
PEP8 fixes
693
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
694
class _InventoryNoneEntry(object):
695
    """This represents an inventory entry which *isn't there*.
696
697
    It simplifies the merging logic if we always have an InventoryEntry, even
698
    if it isn't actually present
699
    """
700
    executable = None
701
    kind = None
702
    name = None
703
    parent_id = None
704
    revision = None
705
    symlink_target = None
706
    text_sha1 = None
707
708
_none_entry = _InventoryNoneEntry()
709
710
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
711
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
712
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
713
    requires_base = True
714
    supports_reprocess = True
715
    supports_show_base = True
716
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
717
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
718
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
719
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
720
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
721
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
722
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
723
                 interesting_ids=None, reprocess=False, show_base=False,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
724
                 change_reporter=None, interesting_files=None, do_merge=True,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
725
                 cherrypick=False, lca_trees=None, this_branch=None,
726
                 other_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
727
        """Initialize the merger object and perform the merge.
728
729
        :param working_tree: The working tree to apply the merge to
730
        :param this_tree: The local tree in the merge operation
731
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
732
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
733
        :param this_branch: The branch associated with this_tree.  Defaults to
734
            this_tree.branch if not supplied.
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
735
        :param other_branch: The branch associated with other_tree, if any.
2590.2.10 by Aaron Bentley
Updates from review
736
        :param interesting_ids: The file_ids of files that should be
737
            participate in the merge.  May not be combined with
738
            interesting_files.
739
        :param: reprocess If True, perform conflict-reduction processing.
740
        :param show_base: If True, show the base revision in text conflicts.
741
            (incompatible with reprocess)
742
        :param change_reporter: An object that should report changes made
743
        :param interesting_files: The tree-relative paths of files that should
744
            participate in the merge.  If these paths refer to directories,
745
            the contents of those directories will also be included.  May not
746
            be combined with interesting_ids.  If neither interesting_files nor
747
            interesting_ids is specified, all files may participate in the
748
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
749
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
750
            if the ancestry was found to include a criss-cross merge.
751
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
752
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
753
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
754
        if interesting_files is not None and interesting_ids is not None:
755
            raise ValueError(
756
                'specify either interesting_ids or interesting_files')
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
757
        if this_branch is None:
758
            this_branch = this_tree.branch
2590.2.4 by Aaron Bentley
Move entry generation to a helper
759
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
760
        self.interesting_files = interesting_files
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
761
        self.working_tree = working_tree
762
        self.this_tree = this_tree
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
763
        self.base_tree = base_tree
764
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
765
        self.this_branch = this_branch
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
766
        self.other_branch = other_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
767
        self._raw_conflicts = []
768
        self.cooked_conflicts = []
769
        self.reprocess = reprocess
770
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
771
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
772
        # Uncommenting this will change the default algorithm to always use
773
        # _entries_lca. This can be useful for running the test suite and
774
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
775
        # if lca_trees is None:
776
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
777
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
778
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
779
        if do_merge:
780
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
781
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
782
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
783
        operation = cleanup.OperationWithCleanups(self._do_merge)
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
784
        self.working_tree.lock_tree_write()
785
        operation.add_cleanup(self.working_tree.unlock)
786
        self.this_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
787
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
788
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
789
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
790
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
791
        operation.add_cleanup(self.other_tree.unlock)
792
        operation.run()
793
794
    def _do_merge(self, operation):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
795
        self.tt = transform.TreeTransform(self.working_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
796
        operation.add_cleanup(self.tt.finalize)
797
        self._compute_transform()
798
        results = self.tt.apply(no_conflicts=True)
799
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
800
        try:
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
801
            self.working_tree.add_conflicts(self.cooked_conflicts)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
802
        except errors.UnsupportedOperation:
803
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
804
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
805
    def make_preview_transform(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
806
        operation = cleanup.OperationWithCleanups(self._make_preview_transform)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
807
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
808
        operation.add_cleanup(self.base_tree.unlock)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
809
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
810
        operation.add_cleanup(self.other_tree.unlock)
811
        return operation.run_simple()
812
813
    def _make_preview_transform(self):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
814
        self.tt = transform.TransformPreview(self.working_tree)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
815
        self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
816
        return self.tt
817
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
818
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
819
        if self._lca_trees is None:
820
            entries = self._entries3()
821
            resolver = self._three_way
822
        else:
823
            entries = self._entries_lca()
824
            resolver = self._lca_multi_way
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
825
        # Prepare merge hooks
826
        factories = Merger.hooks['merge_file_content']
827
        # One hook for each registered one plus our default merger
828
        hooks = [factory(self) for factory in factories] + [self]
829
        self.active_hooks = [hook for hook in hooks if hook is not None]
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
830
        child_pb = ui.ui_factory.nested_progress_bar()
831
        try:
832
            for num, (file_id, changed, parents3, names3,
833
                      executable3) in enumerate(entries):
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
834
                # Try merging each entry
835
                child_pb.update(gettext('Preparing file merge'),
836
                                num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
837
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
838
                if changed:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
839
                    file_status = self._do_merge_contents(file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
840
                else:
841
                    file_status = 'unmodified'
842
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
843
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
844
        finally:
845
            child_pb.finished()
5993.2.4 by Jelmer Vernooij
Remove feature flag.
846
        self.tt.fixup_new_roots()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
847
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
848
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
849
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
850
        """Finalize the transform and report the changes.
851
852
        This is the second half of _compute_transform.
853
        """
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
854
        child_pb = ui.ui_factory.nested_progress_bar()
855
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
856
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
857
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
858
        finally:
859
            child_pb.finished()
860
        if self.change_reporter is not None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
861
            from breezy import delta
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
862
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
863
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
864
        self.cook_conflicts(fs_conflicts)
865
        for conflict in self.cooked_conflicts:
5898.1.6 by Martin
Avoid implicit str casting in trace methods by calling unicode() on conflict objects first
866
            trace.warning(unicode(conflict))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
867
2590.2.4 by Aaron Bentley
Move entry generation to a helper
868
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
869
        """Gather data about files modified between three trees.
870
871
        Return a list of tuples of file_id, changed, parents3, names3,
872
        executable3.  changed is a boolean indicating whether the file contents
873
        or kind were changed.  parents3 is a tuple of parent ids for base,
874
        other and this.  names3 is a tuple of names for base, other and this.
875
        executable3 is a tuple of execute-bit values for base, other and this.
876
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
877
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
878
        iterator = self.other_tree.iter_changes(self.base_tree,
5783.2.1 by John Arbash Meinel
Remove the 'include_unchanged=True' from iter_changes.
879
                specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
880
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
881
        this_entries = dict((e.file_id, e) for p, e in
882
                            self.this_tree.iter_entries_by_dir(
883
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
884
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
885
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
886
            if (self.interesting_ids is not None and
887
                file_id not in self.interesting_ids):
888
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
889
            entry = this_entries.get(file_id)
890
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
891
                this_name = entry.name
892
                this_parent = entry.parent_id
893
                this_executable = entry.executable
894
            else:
895
                this_name = None
896
                this_parent = None
897
                this_executable = None
898
            parents3 = parents + (this_parent,)
899
            names3 = names + (this_name,)
900
            executable3 = executable + (this_executable,)
901
            result.append((file_id, changed, parents3, names3, executable3))
902
        return result
903
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
904
    def _entries_lca(self):
905
        """Gather data about files modified between multiple trees.
906
907
        This compares OTHER versus all LCA trees, and for interesting entries,
908
        it then compares with THIS and BASE.
909
910
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
911
912
        :return: [(file_id, changed, parents, names, executable)], where:
913
914
            * file_id: Simple file_id of the entry
915
            * changed: Boolean, True if the kind or contents changed else False
916
            * parents: ((base, [parent_id, in, lcas]), parent_id_other,
917
                        parent_id_this)
918
            * names:   ((base, [name, in, lcas]), name_in_other, name_in_this)
919
            * executable: ((base, [exec, in, lcas]), exec_in_other,
920
                        exec_in_this)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
921
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
922
        if self.interesting_files is not None:
923
            lookup_trees = [self.this_tree, self.base_tree]
924
            lookup_trees.extend(self._lca_trees)
925
            # I think we should include the lca trees as well
926
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
927
                                                        lookup_trees)
928
        else:
929
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
930
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
931
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
932
6405.2.10 by Jelmer Vernooij
Fix more tests.
933
        base_inventory = self.base_tree.root_inventory
934
        this_inventory = self.this_tree.root_inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
935
        for path, file_id, other_ie, lca_values in walker.iter_all():
936
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
937
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
938
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
939
            if interesting_ids is not None and file_id not in interesting_ids:
940
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
941
3514.4.30 by John Arbash Meinel
Several updates.
942
            # If other_revision is found in any of the lcas, that means this
943
            # node is uninteresting. This is because when merging, if there are
944
            # multiple heads(), we have to create a new node. So if we didn't,
945
            # we know that the ancestry is linear, and that OTHER did not
946
            # modify anything
947
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
948
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
949
            if other_revision is not None:
950
                # We can't use this shortcut when other_revision is None,
951
                # because it may be None because things are WorkingTrees, and
952
                # not because it is *actually* None.
953
                is_unmodified = False
954
                for lca_path, ie in lca_values:
955
                    if ie is not None and ie.revision == other_revision:
956
                        is_unmodified = True
957
                        break
958
                if is_unmodified:
959
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
960
961
            lca_entries = []
962
            for lca_path, lca_ie in lca_values:
963
                if lca_ie is None:
964
                    lca_entries.append(_none_entry)
965
                else:
966
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
967
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
968
            if base_inventory.has_id(file_id):
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
969
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
970
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
971
                base_ie = _none_entry
972
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
973
            if this_inventory.has_id(file_id):
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
974
                this_ie = this_inventory[file_id]
975
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
976
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
977
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
978
            lca_kinds = []
979
            lca_parent_ids = []
980
            lca_names = []
981
            lca_executable = []
982
            for lca_ie in lca_entries:
983
                lca_kinds.append(lca_ie.kind)
984
                lca_parent_ids.append(lca_ie.parent_id)
985
                lca_names.append(lca_ie.name)
986
                lca_executable.append(lca_ie.executable)
987
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
988
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
989
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
990
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
991
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
992
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
993
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
994
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
995
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
996
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
997
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
998
            content_changed = True
999
            if kind_winner == 'this':
1000
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1001
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1002
                    if parent_id_winner == 'this' and name_winner == 'this':
1003
                        # No change for this directory in OTHER, skip
1004
                        continue
1005
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1006
                elif other_ie.kind is None or other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1007
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1008
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1009
                            return None
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1010
                        return tree.get_file_sha1(tree.id2path(file_id), file_id)
3514.4.30 by John Arbash Meinel
Several updates.
1011
                    base_sha1 = get_sha1(base_ie, self.base_tree)
1012
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
1013
                                 in zip(lca_entries, self._lca_trees)]
1014
                    this_sha1 = get_sha1(this_ie, self.this_tree)
1015
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1016
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1017
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1018
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1019
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1020
                        (base_ie.executable, lca_executable),
1021
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1022
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1023
                        and sha1_winner == 'this' and exec_winner == 'this'):
1024
                        # No kind, parent, name, exec, or content change for
1025
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1026
                        continue
1027
                    if sha1_winner == 'this':
1028
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1029
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1030
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1031
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1032
                            return None
6809.4.21 by Jelmer Vernooij
Fix long lines.
1033
                        path = tree.id2path(file_id)
1034
                        return tree.get_symlink_target(path, file_id)
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1035
                    base_target = get_target(base_ie, self.base_tree)
1036
                    lca_targets = [get_target(ie, tree) for ie, tree
1037
                                   in zip(lca_entries, self._lca_trees)]
1038
                    this_target = get_target(this_ie, self.this_tree)
1039
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1040
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1041
                        (base_target, lca_targets),
1042
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1043
                    if (parent_id_winner == 'this' and name_winner == 'this'
1044
                        and target_winner == 'this'):
1045
                        # No kind, parent, name, or symlink target change
1046
                        # not interesting
1047
                        continue
1048
                    if target_winner == 'this':
1049
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1050
                elif other_ie.kind == 'tree-reference':
1051
                    # The 'changed' information seems to be handled at a higher
1052
                    # level. At least, _entries3 returns False for content
1053
                    # changed, even when at a new revision_id.
1054
                    content_changed = False
1055
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1056
                        # Nothing interesting
1057
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1058
                else:
1059
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1060
1061
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1062
            result.append((file_id, content_changed,
1063
                           ((base_ie.parent_id, lca_parent_ids),
1064
                            other_ie.parent_id, this_ie.parent_id),
1065
                           ((base_ie.name, lca_names),
1066
                            other_ie.name, this_ie.name),
1067
                           ((base_ie.executable, lca_executable),
1068
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1069
                          ))
1070
        return result
1071
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1072
    def write_modified(self, results):
1073
        modified_hashes = {}
1074
        for path in results.modified_paths:
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1075
            wt_relpath = self.working_tree.relpath(path)
1076
            file_id = self.working_tree.path2id(wt_relpath)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1077
            if file_id is None:
1078
                continue
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1079
            hash = self.working_tree.get_file_sha1(wt_relpath, file_id)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1080
            if hash is None:
1081
                continue
1082
            modified_hashes[file_id] = hash
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
1083
        self.working_tree.set_merge_modified(modified_hashes)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1084
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1085
    @staticmethod
1086
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1087
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1088
        if entry is None:
1089
            return None
1090
        return entry.parent_id
1091
1092
    @staticmethod
1093
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1094
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1095
        if entry is None:
1096
            return None
1097
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1098
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1099
    @staticmethod
1100
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1101
        """Determine the sha1 of the file contents (used as a key method)."""
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1102
        try:
1103
            path = tree.id2path(file_id)
1104
        except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1105
            return None
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1106
        return tree.get_file_sha1(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1107
1108
    @staticmethod
1109
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1110
        """Determine the executability of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1111
        try:
1112
            path = tree.id2path(file_id)
1113
        except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1114
            return None
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1115
        if tree.kind(path, file_id) != "file":
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1116
            return False
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1117
        return tree.is_executable(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1118
1119
    @staticmethod
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1120
    def kind(tree, path, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1121
        """Determine the kind of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1122
        try:
1123
            path = tree.id2path(file_id)
1124
        except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1125
            return None
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1126
        return tree.kind(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1127
1128
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1129
    def _three_way(base, other, this):
1130
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1131
            # if 'base == other', either they all agree, or only 'this' has
1132
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1133
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1134
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1135
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1136
            return 'conflict'
1137
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1138
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1139
            return "this"
1140
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1141
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1142
            return "other"
1143
1144
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1145
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1146
        """Consider LCAs when determining whether a change has occurred.
1147
1148
        If LCAS are all identical, this is the same as a _three_way comparison.
1149
1150
        :param bases: value in (BASE, [LCAS])
1151
        :param other: value in OTHER
1152
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1153
        :param allow_overriding_lca: If there is more than one unique lca
1154
            value, allow OTHER to override THIS if it has a new value, and
1155
            THIS only has an lca value, or vice versa. This is appropriate for
1156
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1157
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1158
            changed or not.
1159
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1160
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1161
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1162
        if other == this:
1163
            # Either Ambiguously clean, or nothing was actually changed. We
1164
            # don't really care
1165
            return 'this'
1166
        base_val, lca_vals = bases
1167
        # Remove 'base_val' from the lca_vals, because it is not interesting
1168
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1169
                                      if lca_val != base_val]
1170
        if len(filtered_lca_vals) == 0:
1171
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1172
1173
        unique_lca_vals = set(filtered_lca_vals)
1174
        if len(unique_lca_vals) == 1:
1175
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1176
1177
        if allow_overriding_lca:
1178
            if other in unique_lca_vals:
1179
                if this in unique_lca_vals:
1180
                    # Each side picked a different lca, conflict
1181
                    return 'conflict'
1182
                else:
1183
                    # This has a value which supersedes both lca values, and
1184
                    # other only has an lca value
1185
                    return 'this'
1186
            elif this in unique_lca_vals:
1187
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1188
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1189
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1190
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1191
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1192
        return 'conflict'
1193
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1194
    def merge_names(self, file_id):
1195
        def get_entry(tree):
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1196
            try:
6405.2.10 by Jelmer Vernooij
Fix more tests.
1197
                return tree.root_inventory[file_id]
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1198
            except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1199
                return None
1200
        this_entry = get_entry(self.this_tree)
1201
        other_entry = get_entry(self.other_tree)
1202
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1203
        entries = (base_entry, other_entry, this_entry)
1204
        names = []
1205
        parents = []
1206
        for entry in entries:
1207
            if entry is None:
1208
                names.append(None)
1209
                parents.append(None)
1210
            else:
1211
                names.append(entry.name)
1212
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1213
        return self._merge_names(file_id, parents, names,
1214
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1215
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1216
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1217
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1218
        base_name, other_name, this_name = names
1219
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1220
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1221
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1222
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1223
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1224
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1225
            if name_winner == "this":
1226
                name_winner = "other"
1227
            if parent_id_winner == "this":
1228
                parent_id_winner = "other"
1229
        if name_winner == "this" and parent_id_winner == "this":
1230
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1231
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1232
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1233
            # road if a ContentConflict needs to be created so we should not do
1234
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1235
            trans_id = self.tt.trans_id_file_id(file_id)
1236
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1237
                                        this_parent, this_name,
1238
                                        other_parent, other_name))
5954.4.2 by Aaron Bentley
Support merging into null tree.
1239
        if not self.other_tree.has_id(file_id):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1240
            # it doesn't matter whether the result was 'other' or
5954.4.6 by Aaron Bentley
Updates from review.
1241
            # 'conflict'-- if it has no file id, we leave it alone.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1242
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1243
        parent_id = parents[self.winner_idx[parent_id_winner]]
5954.4.2 by Aaron Bentley
Support merging into null tree.
1244
        name = names[self.winner_idx[name_winner]]
1245
        if parent_id is not None or name is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1246
            # if we get here, name_winner and parent_winner are set to safe
1247
            # values.
5954.4.2 by Aaron Bentley
Support merging into null tree.
1248
            if parent_id is None and name is not None:
1249
                # if parent_id is None and name is non-None, current file is
1250
                # the tree root.
1251
                if names[self.winner_idx[parent_id_winner]] != '':
1252
                    raise AssertionError(
1253
                        'File looks like a root, but named %s' %
1254
                        names[self.winner_idx[parent_id_winner]])
1255
                parent_trans_id = transform.ROOT_PARENT
1256
            else:
1257
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1258
            self.tt.adjust_path(name, parent_trans_id,
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1259
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1260
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1261
    def _do_merge_contents(self, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1262
        """Performs a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1263
        def contents_pair(tree):
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1264
            try:
1265
                path = tree.id2path(file_id)
1266
            except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1267
                return (None, None)
6809.4.17 by Jelmer Vernooij
One more :)
1268
            try:
1269
                kind = tree.kind(path, file_id)
1270
            except errors.NoSuchFile:
1271
                return (None, None)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1272
            if kind == "file":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1273
                contents = tree.get_file_sha1(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1274
            elif kind == "symlink":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1275
                contents = tree.get_symlink_target(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1276
            else:
1277
                contents = None
1278
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1279
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1280
        # See SPOT run.  run, SPOT, run.
1281
        # So we're not QUITE repeating ourselves; we do tricky things with
1282
        # file kind...
1283
        base_pair = contents_pair(self.base_tree)
1284
        other_pair = contents_pair(self.other_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1285
        if self._lca_trees:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1286
            this_pair = contents_pair(self.this_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1287
            lca_pairs = [contents_pair(tree) for tree in self._lca_trees]
1288
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1289
                                         this_pair, allow_overriding_lca=False)
1290
        else:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1291
            if base_pair == other_pair:
1292
                winner = 'this'
1293
            else:
1294
                # We delayed evaluating this_pair as long as we can to avoid
1295
                # unnecessary sha1 calculation
1296
                this_pair = contents_pair(self.this_tree)
1297
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1298
        if winner == 'this':
1299
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1300
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1301
        # We have a hypothetical conflict, but if we have files, then we
1302
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1303
        trans_id = self.tt.trans_id_file_id(file_id)
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
1304
        params = MergeFileHookParams(self, file_id, trans_id, this_pair[0],
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1305
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1306
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1307
        hook_status = 'not_applicable'
1308
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1309
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1310
            if hook_status != 'not_applicable':
1311
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1312
                break
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1313
        # If the merge ends up replacing the content of the file, we get rid of
1314
        # it at the end of this method (this variable is used to track the
1315
        # exceptions to this rule).
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1316
        keep_this = False
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1317
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1318
        if hook_status == 'not_applicable':
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1319
            # No merge hook was able to resolve the situation. Two cases exist:
1320
            # a content conflict or a duplicate one.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1321
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1322
            name = self.tt.final_name(trans_id)
1323
            parent_id = self.tt.final_parent(trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1324
            duplicate = False
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1325
            inhibit_content_conflict = False
1326
            if params.this_kind is None: # file_id is not in THIS
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1327
                # Is the name used for a different file_id ?
1328
                dupe_path = self.other_tree.id2path(file_id)
1329
                this_id = self.this_tree.path2id(dupe_path)
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1330
                if this_id is not None:
1331
                    # Two entries for the same path
1332
                    keep_this = True
1333
                    # versioning the merged file will trigger a duplicate
1334
                    # conflict
1335
                    self.tt.version_file(file_id, trans_id)
1336
                    transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1337
                        self.tt, trans_id, self.other_tree,
1338
                        self.other_tree.id2path(file_id), file_id=file_id,
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1339
                        filter_tree_path=self._get_filter_tree_path(file_id))
1340
                    inhibit_content_conflict = True
1341
            elif params.other_kind is None: # file_id is not in OTHER
1342
                # Is the name used for a different file_id ?
1343
                dupe_path = self.this_tree.id2path(file_id)
1344
                other_id = self.other_tree.path2id(dupe_path)
1345
                if other_id is not None:
1346
                    # Two entries for the same path again, but here, the other
1347
                    # entry will also be merged.  We simply inhibit the
1348
                    # 'content' conflict creation because we know OTHER will
1349
                    # create (or has already created depending on ordering) an
1350
                    # entry at the same path. This will trigger a 'duplicate'
1351
                    # conflict later.
1352
                    keep_this = True
1353
                    inhibit_content_conflict = True
1354
            if not inhibit_content_conflict:
1355
                if params.this_kind is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1356
                    self.tt.unversion_file(trans_id)
1357
                # This is a contents conflict, because none of the available
1358
                # functions could merge it.
1359
                file_group = self._dump_conflicts(name, parent_id, file_id,
1360
                                                  set_version=True)
1361
                self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1362
        elif hook_status == 'success':
1363
            self.tt.create_file(lines, trans_id)
1364
        elif hook_status == 'conflicted':
1365
            # XXX: perhaps the hook should be able to provide
1366
            # the BASE/THIS/OTHER files?
1367
            self.tt.create_file(lines, trans_id)
1368
            self._raw_conflicts.append(('text conflict', trans_id))
1369
            name = self.tt.final_name(trans_id)
1370
            parent_id = self.tt.final_parent(trans_id)
4869.3.23 by Andrew Bennetts
Remove some confusing code that has no effect.
1371
            self._dump_conflicts(name, parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1372
        elif hook_status == 'delete':
1373
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1374
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1375
        elif hook_status == 'done':
1376
            # The hook function did whatever it needs to do directly, no
1377
            # further action needed here.
1378
            pass
1379
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1380
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1381
        if not self.this_tree.has_id(file_id) and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1382
            self.tt.version_file(file_id, trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1383
        if not keep_this:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1384
            # The merge has been performed and produced a new content, so the
1385
            # old contents should not be retained.
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1386
            self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1387
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1388
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1389
    def _default_other_winner_merge(self, merge_hook_params):
1390
        """Replace this contents with other."""
1391
        file_id = merge_hook_params.file_id
1392
        trans_id = merge_hook_params.trans_id
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1393
        if self.other_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1394
            # OTHER changed the file
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1395
            transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1396
                self.tt, trans_id, self.other_tree,
1397
                self.other_tree.id2path(file_id), file_id=file_id,
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1398
                filter_tree_path=self._get_filter_tree_path(file_id))
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1399
            return 'done', None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1400
        elif self.this_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1401
            # OTHER deleted the file
1402
            return 'delete', None
1403
        else:
1404
            raise AssertionError(
1405
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1406
                % (file_id,))
1407
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1408
    def merge_contents(self, merge_hook_params):
1409
        """Fallback merge logic after user installed hooks."""
1410
        # This function is used in merge hooks as the fallback instance.
1411
        # Perhaps making this function and the functions it calls be a 
1412
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1413
        if merge_hook_params.winner == 'other':
1414
            # OTHER is a straight winner, so replace this contents with other
1415
            return self._default_other_winner_merge(merge_hook_params)
1416
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1417
            # THIS and OTHER are both files, so text merge.  Either
1418
            # BASE is a file, or both converted to files, so at least we
1419
            # have agreement that output should be a file.
1420
            try:
1421
                self.text_merge(merge_hook_params.file_id,
1422
                    merge_hook_params.trans_id)
1423
            except errors.BinaryFile:
1424
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1425
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1426
        else:
1427
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1428
1429
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1430
        """Return the lines in a file, or an empty list."""
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1431
        try:
1432
            path = tree.id2path(file_id)
1433
        except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1434
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1435
        else:
1436
            return tree.get_file_lines(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1437
1438
    def text_merge(self, file_id, trans_id):
1439
        """Perform a three-way text merge on a file_id"""
1440
        # it's possible that we got here with base as a different type.
1441
        # if so, we just want two-way text conflicts.
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1442
        try:
1443
            base_path = self.base_tree.id2path(file_id)
1444
        except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1445
            base_lines = []
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1446
        else:
1447
            if self.base_tree.kind(base_path, file_id) == "file":
1448
                base_lines = self.get_lines(self.base_tree, file_id)
1449
            else:
1450
                base_lines = []
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1451
        other_lines = self.get_lines(self.other_tree, file_id)
1452
        this_lines = self.get_lines(self.this_tree, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1453
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1454
                           is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1455
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1456
        if self.show_base is True:
1457
            base_marker = '|' * 7
1458
        else:
1459
            base_marker = None
1460
1461
        def iter_merge3(retval):
1462
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1463
            for line in m3.merge_lines(name_a = "TREE",
1464
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1465
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1466
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1467
                                       base_marker=base_marker,
1468
                                       reprocess=self.reprocess):
1469
                if line.startswith(start_marker):
1470
                    retval["text_conflicts"] = True
1471
                    yield line.replace(start_marker, '<' * 7)
1472
                else:
1473
                    yield line
1474
        retval = {}
1475
        merge3_iterator = iter_merge3(retval)
1476
        self.tt.create_file(merge3_iterator, trans_id)
1477
        if retval["text_conflicts"] is True:
1478
            self._raw_conflicts.append(('text conflict', trans_id))
1479
            name = self.tt.final_name(trans_id)
1480
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1481
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1482
                                              this_lines, base_lines,
1483
                                              other_lines)
1484
            file_group.append(trans_id)
1485
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1486
1487
    def _get_filter_tree_path(self, file_id):
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1488
        if self.this_tree.supports_content_filtering():
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1489
            # We get the path from the working tree if it exists.
1490
            # That fails though when OTHER is adding a file, so
1491
            # we fall back to the other tree to find the path if
1492
            # it doesn't exist locally.
1493
            try:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1494
                return self.this_tree.id2path(file_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1495
            except errors.NoSuchId:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1496
                return self.other_tree.id2path(file_id)
1497
        # Skip the id2path lookup for older formats
1498
        return None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1499
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1500
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1501
                        base_lines=None, other_lines=None, set_version=False,
1502
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1503
        """Emit conflict files.
1504
        If this_lines, base_lines, or other_lines are omitted, they will be
1505
        determined automatically.  If set_version is true, the .OTHER, .THIS
1506
        or .BASE (in that order) will be created as versioned files.
1507
        """
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1508
        data = [('OTHER', self.other_tree, other_lines),
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1509
                ('THIS', self.this_tree, this_lines)]
1510
        if not no_base:
1511
            data.append(('BASE', self.base_tree, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1512
1513
        # We need to use the actual path in the working tree of the file here,
1514
        # ignoring the conflict suffixes
1515
        wt = self.this_tree
1516
        if wt.supports_content_filtering():
1517
            try:
1518
                filter_tree_path = wt.id2path(file_id)
1519
            except errors.NoSuchId:
1520
                # file has been deleted
1521
                filter_tree_path = None
1522
        else:
1523
            # Skip the id2path lookup for older formats
1524
            filter_tree_path = None
1525
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1526
        versioned = False
1527
        file_group = []
1528
        for suffix, tree, lines in data:
6809.4.21 by Jelmer Vernooij
Fix long lines.
1529
            try:
6809.4.22 by Jelmer Vernooij
Fix typo.
1530
                path = tree.id2path(file_id)
6809.4.23 by Jelmer Vernooij
Fix tests.
1531
            except errors.NoSuchId:
6809.4.21 by Jelmer Vernooij
Fix long lines.
1532
                pass
1533
            else:
1534
                trans_id = self._conflict_file(
1535
                        name, parent_id, path, tree, file_id, suffix, lines,
1536
                        filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1537
                file_group.append(trans_id)
1538
                if set_version and not versioned:
1539
                    self.tt.version_file(file_id, trans_id)
1540
                    versioned = True
1541
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1542
6809.4.21 by Jelmer Vernooij
Fix long lines.
1543
    def _conflict_file(self, name, parent_id, path, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1544
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1545
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1546
        name = name + '.' + suffix
1547
        trans_id = self.tt.create_path(name, parent_id)
6809.4.21 by Jelmer Vernooij
Fix long lines.
1548
        transform.create_from_tree(
1549
                self.tt, trans_id, tree, path,
1550
                file_id=file_id, bytes=lines,
1551
                filter_tree_path=filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1552
        return trans_id
1553
1554
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1555
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1556
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1557
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1558
        self._merge_executable(file_id, executable, file_status,
1559
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1560
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1561
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1562
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1563
        """Perform a merge on the execute bit."""
1564
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1565
        if file_status == "deleted":
1566
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1567
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1568
        if winner == "conflict":
1569
        # There must be a None in here, if we have a conflict, but we
1570
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1571
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1572
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1573
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1574
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1575
        if winner == 'this' and file_status != "modified":
1576
            return
1577
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1578
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1579
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1580
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1581
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1582
        else:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1583
            if self.other_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1584
                executability = other_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1585
            elif self.this_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1586
                executability = this_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1587
            elif self.base_tree_has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1588
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1589
        if executability is not None:
1590
            trans_id = self.tt.trans_id_file_id(file_id)
1591
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1592
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1593
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1594
        """Convert all conflicts into a form that doesn't depend on trans_id"""
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1595
        content_conflict_file_ids = set()
1596
        cooked_conflicts = transform.cook_conflicts(fs_conflicts, self.tt)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1597
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1598
        for conflict in self._raw_conflicts:
1599
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1600
            if conflict_type == 'path conflict':
1601
                (trans_id, file_id,
1602
                this_parent, this_name,
1603
                other_parent, other_name) = conflict[1:]
1604
                if this_parent is None or this_name is None:
1605
                    this_path = '<deleted>'
1606
                else:
1607
                    parent_path =  fp.get_path(
1608
                        self.tt.trans_id_file_id(this_parent))
1609
                    this_path = osutils.pathjoin(parent_path, this_name)
1610
                if other_parent is None or other_name is None:
1611
                    other_path = '<deleted>'
1612
                else:
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1613
                    if other_parent == self.other_tree.get_root_id():
5050.73.9 by Vincent Ladeuil
Fix typo.
1614
                        # The tree transform doesn't know about the other root,
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1615
                        # so we special case here to avoid a NoFinalPath
1616
                        # exception
1617
                        parent_path = ''
1618
                    else:
1619
                        parent_path =  fp.get_path(
1620
                            self.tt.trans_id_file_id(other_parent))
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1621
                    other_path = osutils.pathjoin(parent_path, other_name)
1622
                c = _mod_conflicts.Conflict.factory(
1623
                    'path conflict', path=this_path,
1624
                    conflict_path=other_path,
1625
                    file_id=file_id)
1626
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1627
                for trans_id in conflict[1]:
1628
                    file_id = self.tt.final_file_id(trans_id)
1629
                    if file_id is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1630
                        # Ok we found the relevant file-id
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1631
                        break
1632
                path = fp.get_path(trans_id)
1633
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1634
                    if path.endswith(suffix):
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1635
                        # Here is the raw path
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1636
                        path = path[:-len(suffix)]
1637
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1638
                c = _mod_conflicts.Conflict.factory(conflict_type,
1639
                                                    path=path, file_id=file_id)
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1640
                content_conflict_file_ids.add(file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1641
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1642
                trans_id = conflict[1]
1643
                path = fp.get_path(trans_id)
1644
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1645
                c = _mod_conflicts.Conflict.factory(conflict_type,
1646
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1647
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1648
                raise AssertionError('bad conflict type: %r' % (conflict,))
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1649
            cooked_conflicts.append(c)
5988.2.2 by Vincent Ladeuil
Make it clear that we start from an empty cooked_conflicts list.
1650
1651
        self.cooked_conflicts = []
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1652
        # We want to get rid of path conflicts when a corresponding contents
1653
        # conflict exists. This can occur when one branch deletes a file while
1654
        # the other renames *and* modifies it. In this case, the content
1655
        # conflict is enough.
1656
        for c in cooked_conflicts:
1657
            if (c.typestring == 'path conflict'
1658
                and c.file_id in content_conflict_file_ids):
1659
                continue
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1660
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1661
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1662
1663
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1664
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1665
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1666
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1667
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1668
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1669
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1670
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1671
    def _generate_merge_plan(self, file_id, base):
1672
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1673
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1674
1675
    def _merged_lines(self, file_id):
1676
        """Generate the merged lines.
1677
        There is no distinction between lines that are meant to contain <<<<<<<
1678
        and conflicts.
1679
        """
1680
        if self.cherrypick:
1681
            base = self.base_tree
1682
        else:
1683
            base = None
1684
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1685
        if 'merge' in debug.debug_flags:
1686
            plan = list(plan)
1687
            trans_id = self.tt.trans_id_file_id(file_id)
1688
            name = self.tt.final_name(trans_id) + '.plan'
4634.101.6 by John Arbash Meinel
killed-both and killed-base is 11 chars long.
1689
            contents = ('%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1690
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1691
        textmerge = versionedfile.PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1692
                                                 '>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1693
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1694
        if conflicts:
1695
            base_lines = textmerge.base_from_plan()
1696
        else:
1697
            base_lines = None
1698
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1699
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1700
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1701
        """Perform a (weave) text merge for a given file and file-id.
1702
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1703
        and a conflict will be noted.
1704
        """
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1705
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1706
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1707
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1708
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1709
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1710
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1711
        if base_lines is not None:
1712
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1713
            self._raw_conflicts.append(('text conflict', trans_id))
1714
            name = self.tt.final_name(trans_id)
1715
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1716
            file_group = self._dump_conflicts(name, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1717
                                              no_base=False,
1718
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1719
            file_group.append(trans_id)
1720
1721
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1722
class LCAMerger(WeaveMerger):
1723
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1724
    def _generate_merge_plan(self, file_id, base):
1725
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1726
                                                  base=base)
1727
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1728
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1729
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1730
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1731
    def dump_file(self, temp_dir, name, tree, file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1732
        out_path = osutils.pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1733
        out_file = open(out_path, "wb")
1734
        try:
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1735
            in_file = tree.get_file(tree.id2path(file_id), file_id)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1736
            for line in in_file:
1737
                out_file.write(line)
1738
        finally:
1739
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1740
        return out_path
1741
1742
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1743
        """Perform a diff3 merge using a specified file-id and trans-id.
1744
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1745
        will be dumped, and a will be conflict noted.
1746
        """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1747
        import breezy.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1748
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1749
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1750
            new_file = osutils.pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1751
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1752
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1753
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1754
            status = breezy.patch.diff3(new_file, this, base, other)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1755
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1756
                raise errors.BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1757
            f = open(new_file, 'rb')
1758
            try:
1759
                self.tt.create_file(f, trans_id)
1760
            finally:
1761
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1762
            if status == 1:
1763
                name = self.tt.final_name(trans_id)
1764
                parent_id = self.tt.final_parent(trans_id)
1765
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1766
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1767
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1768
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1769
1770
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1771
class PathNotInTree(errors.BzrError):
1772
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1773
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1774
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1775
    def __init__(self, path, tree):
1776
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1777
1778
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1779
class MergeIntoMerger(Merger):
1780
    """Merger that understands other_tree will be merged into a subdir.
1781
1782
    This also changes the Merger api so that it uses real Branch, revision_id,
1783
    and RevisonTree objects, rather than using revision specs.
1784
    """
1785
1786
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
5246.2.22 by Andrew Bennetts
Minor tweaks.
1787
            source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1788
        """Create a new MergeIntoMerger object.
1789
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1790
        source_subpath in other_tree will be effectively copied to
1791
        target_subdir in this_tree.
1792
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1793
        :param this_tree: The tree that we will be merging into.
1794
        :param other_branch: The Branch we will be merging from.
1795
        :param other_tree: The RevisionTree object we want to merge.
1796
        :param target_subdir: The relative path where we want to merge
1797
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1798
        :param source_subpath: The relative path specifying the subtree of
1799
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1800
        """
1801
        # It is assumed that we are merging a tree that is not in our current
1802
        # ancestry, which means we are using the "EmptyTree" as our basis.
1803
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
1804
                                _mod_revision.NULL_REVISION)
1805
        super(MergeIntoMerger, self).__init__(
1806
            this_branch=this_tree.branch,
1807
            this_tree=this_tree,
1808
            other_tree=other_tree,
1809
            base_tree=null_ancestor_tree,
1810
            )
1811
        self._target_subdir = target_subdir
1812
        self._source_subpath = source_subpath
1813
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1814
        if other_rev_id is None:
1815
            other_rev_id = other_tree.get_revision_id()
1816
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1817
        self.base_is_ancestor = True
1818
        self.backup_files = True
1819
        self.merge_type = Merge3Merger
1820
        self.show_base = False
1821
        self.reprocess = False
1822
        self.interesting_ids = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1823
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
1824
              target_subdir=self._target_subdir,
1825
              source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1826
        if self._source_subpath != '':
1827
            # If this isn't a partial merge make sure the revisions will be
1828
            # present.
1829
            self._maybe_fetch(self.other_branch, self.this_branch,
1830
                self.other_basis)
1831
1832
    def set_pending(self):
1833
        if self._source_subpath != '':
1834
            return
1835
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1836
1837
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1838
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1839
    """Wrap a merge-type class to provide extra parameters.
1840
    
1841
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1842
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1843
    the 'merge_type' member.  It is difficult override do_merge without
1844
    re-writing the whole thing, so instead we create a wrapper which will pass
1845
    the extra parameters.
1846
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1847
1848
    def __init__(self, merge_type, **kwargs):
1849
        self._extra_kwargs = kwargs
1850
        self._merge_type = merge_type
1851
1852
    def __call__(self, *args, **kwargs):
1853
        kwargs.update(self._extra_kwargs)
1854
        return self._merge_type(*args, **kwargs)
1855
1856
    def __getattr__(self, name):
1857
        return getattr(self._merge_type, name)
1858
1859
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1860
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1861
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1862
1863
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1864
        """Initialize the merger object.
1865
1866
        :param args: See Merge3Merger.__init__'s args.
1867
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1868
            source_subpath and target_subdir.
1869
        :keyword source_subpath: The relative path specifying the subtree of
1870
            other_tree to merge into this_tree.
1871
        :keyword target_subdir: The relative path where we want to merge
1872
            other_tree into this_tree
1873
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1874
        # All of the interesting work happens during Merge3Merger.__init__(),
1875
        # so we have have to hack in to get our extra parameters set.
1876
        self._source_subpath = kwargs.pop('source_subpath')
1877
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1878
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1879
1880
    def _compute_transform(self):
1881
        child_pb = ui.ui_factory.nested_progress_bar()
1882
        try:
1883
            entries = self._entries_to_incorporate()
1884
            entries = list(entries)
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1885
            for num, (entry, parent_id, path) in enumerate(entries):
6138.4.1 by Jonathan Riddell
add gettext to progress bar strings
1886
                child_pb.update(gettext('Preparing file merge'), num, len(entries))
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1887
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1888
                trans_id = transform.new_by_entry(path, self.tt, entry,
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1889
                    parent_trans_id, self.other_tree)
1890
        finally:
1891
            child_pb.finished()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1892
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1893
1894
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1895
        """Yields pairs of (inventory_entry, new_parent)."""
6405.2.10 by Jelmer Vernooij
Fix more tests.
1896
        other_inv = self.other_tree.root_inventory
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1897
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1898
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1899
            # XXX: The error would be clearer if it gave the URL of the source
1900
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1901
            raise PathNotInTree(self._source_subpath, "Source tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1902
        subdir = other_inv[subdir_id]
1903
        parent_in_target = osutils.dirname(self._target_subdir)
6405.2.10 by Jelmer Vernooij
Fix more tests.
1904
        target_id = self.this_tree.path2id(parent_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1905
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1906
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1907
        name_in_target = osutils.basename(self._target_subdir)
1908
        merge_into_root = subdir.copy()
1909
        merge_into_root.name = name_in_target
6405.2.10 by Jelmer Vernooij
Fix more tests.
1910
        if self.this_tree.has_id(merge_into_root.file_id):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1911
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1912
            # This can happen fairly easily if the directory we are
1913
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1914
            # their root_id.  Users will expect this to Just Work, so we
1915
            # change the file-id here.
1916
            # Non-root file-ids could potentially conflict too.  That's really
1917
            # an edge case, so we don't do anything special for those.  We let
1918
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1919
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1920
        yield (merge_into_root, target_id, '')
5246.2.10 by Andrew Bennetts
Add more tests.
1921
        if subdir.kind != 'directory':
1922
            # No children, so we are done.
1923
            return
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1924
        for path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1925
            parent_id = entry.parent_id
1926
            if parent_id == subdir.file_id:
1927
                # The root's parent ID has changed, so make sure children of
1928
                # the root refer to the new ID.
1929
                parent_id = merge_into_root.file_id
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1930
            yield (entry, parent_id, path)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1931
1932
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1933
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1934
                backup_files=False,
1935
                merge_type=Merge3Merger,
1936
                interesting_ids=None,
1937
                show_base=False,
1938
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1939
                other_rev_id=None,
1940
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1941
                this_tree=None,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
1942
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1943
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1944
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1945
    Typical use is probably::
1946
1947
        merge_inner(branch, branch.get_revision_tree(other_revision),
1948
                    branch.get_revision_tree(base_revision))
1949
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1950
    if this_tree is None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1951
        raise errors.BzrError("breezy.merge.merge_inner requires a this_tree "
5993.2.1 by Jelmer Vernooij
Add test for rootless tree merge.
1952
                              "parameter")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1953
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
6719.1.2 by Jelmer Vernooij
Fix some tests.
1954
                    change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1955
    merger.backup_files = backup_files
1956
    merger.merge_type = merge_type
1957
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1958
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1959
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1960
        if interesting_ids:
1961
            raise ValueError('Only supply interesting_ids'
1962
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1963
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1964
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1965
    merger.reprocess = reprocess
1966
    merger.other_rev_id = other_rev_id
1967
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1968
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1969
    if get_revision_id is None:
1970
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1971
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1972
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1973
    return merger.do_merge()
1974
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1975
1976
merge_type_registry = registry.Registry()
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1977
merge_type_registry.register('diff3', Diff3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1978
                             "Merge using external diff3.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1979
merge_type_registry.register('lca', LCAMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1980
                             "LCA-newness merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1981
merge_type_registry.register('merge3', Merge3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1982
                             "Native diff3-style merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1983
merge_type_registry.register('weave', WeaveMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1984
                             "Weave-based merge.")
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1985
1986
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1987
def get_merge_type_registry():
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1988
    """Merge type registry was previously in breezy.option
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1989
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1990
    This method provides a backwards compatible way to retrieve it.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1991
    """
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1992
    return merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1993
1994
1995
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1996
    def status_a(revision, text):
1997
        if revision in ancestors_b:
1998
            return 'killed-b', text
1999
        else:
2000
            return 'new-a', text
2001
2002
    def status_b(revision, text):
2003
        if revision in ancestors_a:
2004
            return 'killed-a', text
2005
        else:
2006
            return 'new-b', text
2007
2008
    plain_a = [t for (a, t) in annotated_a]
2009
    plain_b = [t for (a, t) in annotated_b]
2010
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
2011
    blocks = matcher.get_matching_blocks()
2012
    a_cur = 0
2013
    b_cur = 0
2014
    for ai, bi, l in blocks:
2015
        # process all mismatched sections
2016
        # (last mismatched section is handled because blocks always
2017
        # includes a 0-length last block)
2018
        for revision, text in annotated_a[a_cur:ai]:
2019
            yield status_a(revision, text)
2020
        for revision, text in annotated_b[b_cur:bi]:
2021
            yield status_b(revision, text)
2022
        # and now the matched section
2023
        a_cur = ai + l
2024
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
2025
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
2026
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2027
2028
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2029
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2030
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2031
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2032
        """Contructor.
2033
2034
        :param a_rev: Revision-id of one revision to merge
2035
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2036
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2037
        :param key_prefix: A prefix for accessing keys in vf, typically
2038
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2039
        """
2040
        self.a_rev = a_rev
2041
        self.b_rev = b_rev
2042
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2043
        self._last_lines = None
2044
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2045
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2046
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2047
        self._precache_tip_lines()
2048
2049
    def _precache_tip_lines(self):
2050
        lines = self.get_lines([self.a_rev, self.b_rev])
2051
        self.lines_a = lines[self.a_rev]
2052
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2053
2054
    def get_lines(self, revisions):
2055
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2056
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2057
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2058
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2059
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2060
        result = {}
2061
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2062
            if record.storage_kind == 'absent':
2063
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2064
            result[record.key[-1]] = osutils.chunks_to_lines(
2065
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2066
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2067
2068
    def plan_merge(self):
2069
        """Generate a 'plan' for merging the two revisions.
2070
2071
        This involves comparing their texts and determining the cause of
2072
        differences.  If text A has a line and text B does not, then either the
2073
        line was added to text A, or it was deleted from B.  Once the causes
2074
        are combined, they are written out in the format described in
2075
        VersionedFile.plan_merge
2076
        """
2077
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2078
        unique_a, unique_b = self._unique_lines(blocks)
2079
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2080
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2081
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2082
2083
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2084
        last_i = 0
2085
        last_j = 0
2086
        for i, j, n in blocks:
2087
            for a_index in range(last_i, i):
2088
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2089
                    if a_index in killed_b:
2090
                        yield 'conflicted-a', self.lines_a[a_index]
2091
                    else:
2092
                        yield 'new-a', self.lines_a[a_index]
2093
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2094
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2095
            for b_index in range(last_j, j):
2096
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2097
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2098
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2099
                    else:
2100
                        yield 'new-b', self.lines_b[b_index]
2101
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2102
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2103
            # handle common lines
2104
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2105
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2106
            last_i = i+n
2107
            last_j = j+n
2108
2109
    def _get_matching_blocks(self, left_revision, right_revision):
2110
        """Return a description of which sections of two revisions match.
2111
2112
        See SequenceMatcher.get_matching_blocks
2113
        """
3144.3.7 by Aaron Bentley
Update from review
2114
        cached = self._cached_matching_blocks.get((left_revision,
2115
                                                   right_revision))
2116
        if cached is not None:
2117
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2118
        if self._last_lines_revision_id == left_revision:
2119
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2120
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2121
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2122
            lines = self.get_lines([left_revision, right_revision])
2123
            left_lines = lines[left_revision]
2124
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2125
        self._last_lines = right_lines
2126
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2127
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2128
                                                       right_lines)
2129
        return matcher.get_matching_blocks()
2130
2131
    def _unique_lines(self, matching_blocks):
2132
        """Analyse matching_blocks to determine which lines are unique
2133
2134
        :return: a tuple of (unique_left, unique_right), where the values are
2135
            sets of line numbers of unique lines.
2136
        """
2137
        last_i = 0
2138
        last_j = 0
2139
        unique_left = []
2140
        unique_right = []
2141
        for i, j, n in matching_blocks:
2142
            unique_left.extend(range(last_i, i))
2143
            unique_right.extend(range(last_j, j))
2144
            last_i = i + n
2145
            last_j = j + n
2146
        return unique_left, unique_right
2147
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2148
    @staticmethod
2149
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2150
        """Remove changes from new_plan that came from old_plan.
2151
2152
        It is assumed that the difference between the old_plan and new_plan
2153
        is their choice of 'b' text.
2154
2155
        All lines from new_plan that differ from old_plan are emitted
2156
        verbatim.  All lines from new_plan that match old_plan but are
2157
        not about the 'b' revision are emitted verbatim.
2158
2159
        Lines that match and are about the 'b' revision are the lines we
2160
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2161
        is skipped entirely.
2162
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2163
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2164
                                                       new_plan)
2165
        last_j = 0
2166
        for i, j, n in matcher.get_matching_blocks():
2167
            for jj in range(last_j, j):
2168
                yield new_plan[jj]
2169
            for jj in range(j, j+n):
2170
                plan_line = new_plan[jj]
2171
                if plan_line[0] == 'new-b':
2172
                    pass
2173
                elif plan_line[0] == 'killed-b':
2174
                    yield 'unchanged', plan_line[1]
2175
                else:
2176
                    yield plan_line
2177
            last_j = j + n
2178
2179
2180
class _PlanMerge(_PlanMergeBase):
2181
    """Plan an annotate merge using on-the-fly annotation"""
2182
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2183
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2184
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2185
        self.a_key = self._key_prefix + (self.a_rev,)
2186
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2187
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2188
        heads = self.graph.heads((self.a_key, self.b_key))
2189
        if len(heads) == 1:
2190
            # one side dominates, so we can just return its values, yay for
2191
            # per-file graphs
2192
            # Ideally we would know that before we get this far
2193
            self._head_key = heads.pop()
2194
            if self._head_key == self.a_key:
2195
                other = b_rev
2196
            else:
2197
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2198
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2199
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2200
            self._weave = None
2201
        else:
2202
            self._head_key = None
2203
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2204
2205
    def _precache_tip_lines(self):
2206
        # Turn this into a no-op, because we will do this later
2207
        pass
2208
2209
    def _find_recursive_lcas(self):
2210
        """Find all the ancestors back to a unique lca"""
2211
        cur_ancestors = (self.a_key, self.b_key)
2212
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2213
        # rather than a key tuple. We will just map that directly to no common
2214
        # ancestors.
2215
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2216
        while True:
2217
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2218
            # Map a plain NULL_REVISION to a simple no-ancestors
6619.3.12 by Jelmer Vernooij
Use 2to3 set_literal fixer.
2219
            if next_lcas == {_mod_revision.NULL_REVISION}:
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2220
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2221
            # Order the lca's based on when they were merged into the tip
2222
            # While the actual merge portion of weave merge uses a set() of
2223
            # active revisions, the order of insertion *does* effect the
2224
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2225
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2226
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2227
                                                                    next_lcas))
2228
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2229
            if len(next_lcas) == 0:
2230
                break
2231
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2232
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2233
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2234
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2235
                # More than 2 lca's, fall back to grabbing all nodes between
2236
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2237
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2238
                             ' %s, %s\n=> %s',
2239
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2240
                cur_lcas = next_lcas
2241
                while len(cur_lcas) > 1:
2242
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2243
                if len(cur_lcas) == 0:
2244
                    # No common base to find, use the full ancestry
2245
                    unique_lca = None
2246
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2247
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2248
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2249
                        # find_lca will return a plain 'NULL_REVISION' rather
2250
                        # than a key tuple when there is no common ancestor, we
2251
                        # prefer to just use None, because it doesn't confuse
2252
                        # _get_interesting_texts()
2253
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2254
                parent_map.update(self._find_unique_parents(next_lcas,
2255
                                                            unique_lca))
2256
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2257
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2258
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2259
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2260
    def _find_unique_parents(self, tip_keys, base_key):
2261
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2262
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2263
        :param tip_keys: Nodes that are interesting
2264
        :param base_key: Cull all ancestors of this node
2265
        :return: The parent map for all revisions between tip_keys and
2266
            base_key. base_key will be included. References to nodes outside of
2267
            the ancestor set will also be removed.
2268
        """
2269
        # TODO: this would be simpler if find_unique_ancestors took a list
2270
        #       instead of a single tip, internally it supports it, but it
2271
        #       isn't a "backwards compatible" api change.
2272
        if base_key is None:
2273
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2274
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2275
            # thus confuses things like _get_interesting_texts, and our logic
2276
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2277
            if _mod_revision.NULL_REVISION in parent_map:
2278
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2279
        else:
2280
            interesting = set()
2281
            for tip in tip_keys:
2282
                interesting.update(
2283
                    self.graph.find_unique_ancestors(tip, [base_key]))
2284
            parent_map = self.graph.get_parent_map(interesting)
2285
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2286
        culled_parent_map, child_map, tails = self._remove_external_references(
2287
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2288
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2289
        if base_key is not None:
2290
            tails.remove(base_key)
2291
            self._prune_tails(culled_parent_map, child_map, tails)
2292
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2293
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2294
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2295
2296
    @staticmethod
2297
    def _remove_external_references(parent_map):
2298
        """Remove references that go outside of the parent map.
2299
2300
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2301
        :return: (filtered_parent_map, child_map, tails)
2302
            filtered_parent_map is parent_map without external references
2303
            child_map is the {parent_key: [child_keys]} mapping
2304
            tails is a list of nodes that do not have any parents in the map
2305
        """
2306
        # TODO: The basic effect of this function seems more generic than
2307
        #       _PlanMerge. But the specific details of building a child_map,
2308
        #       and computing tails seems very specific to _PlanMerge.
2309
        #       Still, should this be in Graph land?
2310
        filtered_parent_map = {}
2311
        child_map = {}
2312
        tails = []
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
2313
        for key, parent_keys in viewitems(parent_map):
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2314
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2315
            if not culled_parent_keys:
2316
                tails.append(key)
2317
            for parent_key in culled_parent_keys:
2318
                child_map.setdefault(parent_key, []).append(key)
2319
            # TODO: Do we want to do this, it adds overhead for every node,
2320
            #       just to say that the node has no children
2321
            child_map.setdefault(key, [])
2322
            filtered_parent_map[key] = culled_parent_keys
2323
        return filtered_parent_map, child_map, tails
2324
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2325
    @staticmethod
2326
    def _prune_tails(parent_map, child_map, tails_to_remove):
2327
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2328
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2329
        This will remove the supplied revisions until no more children have 0
2330
        parents.
2331
2332
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2333
            be modified in place.
2334
        :param tails_to_remove: A list of tips that should be removed,
2335
            this list will be consumed
2336
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2337
            this dict will be modified
2338
        :return: None, parent_map will be modified in place.
2339
        """
2340
        while tails_to_remove:
2341
            next = tails_to_remove.pop()
2342
            parent_map.pop(next)
2343
            children = child_map.pop(next)
2344
            for child in children:
2345
                child_parents = parent_map[child]
2346
                child_parents.remove(next)
2347
                if len(child_parents) == 0:
2348
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2349
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2350
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2351
        """Return a dict of texts we are interested in.
2352
2353
        Note that the input is in key tuples, but the output is in plain
2354
        revision ids.
2355
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2356
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2357
        :return: A dict of {'revision_id':lines} as returned by
2358
            _PlanMergeBase.get_lines()
2359
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2360
        all_revision_keys = set(parent_map)
2361
        all_revision_keys.add(self.a_key)
2362
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2363
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2364
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2365
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2366
        return all_texts
2367
2368
    def _build_weave(self):
6670.4.3 by Jelmer Vernooij
Fix more imports.
2369
        from .bzr import weave
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2370
        self._weave = weave.Weave(weave_name='in_memory_weave',
2371
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2372
        parent_map = self._find_recursive_lcas()
2373
2374
        all_texts = self._get_interesting_texts(parent_map)
2375
2376
        # Note: Unfortunately, the order given by topo_sort will effect the
2377
        # ordering resolution in the output. Specifically, if you add A then B,
2378
        # then in the output text A lines will show up before B lines. And, of
2379
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2380
        # So we use merge_sort, and add a fake node on the tip.
2381
        # This ensures that left-hand parents will always be inserted into the
2382
        # weave before right-hand parents.
2383
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2384
        parent_map[tip_key] = (self.a_key, self.b_key)
2385
2386
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2387
                                                                  tip_key)):
2388
            if key == tip_key:
2389
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2390
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2391
            parent_keys = parent_map[key]
2392
            revision_id = key[-1]
2393
            parent_ids = [k[-1] for k in parent_keys]
2394
            self._weave.add_lines(revision_id, parent_ids,
2395
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2396
2397
    def plan_merge(self):
2398
        """Generate a 'plan' for merging the two revisions.
2399
2400
        This involves comparing their texts and determining the cause of
2401
        differences.  If text A has a line and text B does not, then either the
2402
        line was added to text A, or it was deleted from B.  Once the causes
2403
        are combined, they are written out in the format described in
2404
        VersionedFile.plan_merge
2405
        """
2406
        if self._head_key is not None: # There was a single head
2407
            if self._head_key == self.a_key:
2408
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2409
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2410
                if self._head_key != self.b_key:
2411
                    raise AssertionError('There was an invalid head: %s != %s'
2412
                                         % (self.b_key, self._head_key))
2413
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2414
            head_rev = self._head_key[-1]
2415
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2416
            return ((plan, line) for line in lines)
2417
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2418
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2419
2420
class _PlanLCAMerge(_PlanMergeBase):
2421
    """
3144.3.7 by Aaron Bentley
Update from review
2422
    This merge algorithm differs from _PlanMerge in that:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2423
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2424
    1. comparisons are done against LCAs only
2425
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2426
       another are marked as conflicts, by emitting the line as conflicted-a
2427
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2428
2429
    This is faster, and hopefully produces more useful output.
2430
    """
2431
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2432
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2433
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2434
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2435
        self.lcas = set()
2436
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2437
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2438
                self.lcas.add(lca)
2439
            else:
2440
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2441
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2442
            if _mod_revision.is_null(lca):
2443
                lca_lines = []
2444
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2445
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2446
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2447
                                                           lca_lines)
2448
            blocks = list(matcher.get_matching_blocks())
2449
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2450
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2451
                                                           lca_lines)
2452
            blocks = list(matcher.get_matching_blocks())
2453
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2454
3144.3.7 by Aaron Bentley
Update from review
2455
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2456
        """Determines the status unique lines versus all lcas.
2457
2458
        Basically, determines why the line is unique to this revision.
2459
2460
        A line may be determined new, killed, or both.
2461
3144.3.7 by Aaron Bentley
Update from review
2462
        If a line is determined new, that means it was not present in at least
2463
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2464
2465
        If a line is determined killed, that means the line was present in
2466
        at least one LCA.
2467
2468
        If a line is killed and new, this indicates that the two merge
2469
        revisions contain differing conflict resolutions.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2470
3144.3.7 by Aaron Bentley
Update from review
2471
        :param revision_id: The id of the revision in which the lines are
2472
            unique
2473
        :param unique_line_numbers: The line numbers of unique lines.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2474
        :return: a tuple of (new_this, killed_other)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2475
        """
2476
        new = set()
2477
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2478
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2479
        for lca in self.lcas:
2480
            blocks = self._get_matching_blocks(revision_id, lca)
2481
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2482
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2483
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2484
        return new, killed