/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
6379.6.1 by Jelmer Vernooij
Import absolute_import in a few places.
17
from __future__ import absolute_import
18
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
19
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
20
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
21
from .lazy_import import lazy_import
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
22
lazy_import(globals(), """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
23
from breezy import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
25
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
26
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
27
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
28
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
29
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
30
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
31
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
32
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
33
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
34
    textfile,
35
    trace,
36
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
37
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
38
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
39
    ui,
6670.4.3 by Jelmer Vernooij
Fix more imports.
40
    workingtree,
41
    )
42
from breezy.bzr import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
43
    versionedfile,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
44
    )
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
45
from breezy.i18n import gettext
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
46
""")
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
47
from . import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
48
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
49
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
50
    hooks,
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
51
    registry,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
52
    )
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
53
from .sixish import (
6973.6.2 by Jelmer Vernooij
Fix more tests.
54
    text_type,
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
55
    viewitems,
56
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
57
# TODO: Report back as changes are merged in
58
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
59
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
60
def transform_tree(from_tree, to_tree, interesting_files=None):
7058.4.25 by Jelmer Vernooij
Use contexts.
61
    with from_tree.lock_tree_write():
62
        merge_inner(from_tree.branch, to_tree, from_tree,
63
            ignore_zero=True, this_tree=from_tree,
64
            interesting_files=interesting_files)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
65
1457.1.12 by Robert Collins
Update comment to reflect author.
66
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
67
class MergeHooks(hooks.Hooks):
68
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
69
    def __init__(self):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
70
        hooks.Hooks.__init__(self, "breezy.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
71
        self.add_hook('merge_file_content',
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
72
            "Called with a breezy.merge.Merger object to create a per file "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
73
            "merge object when starting a merge. "
74
            "Should return either None or a subclass of "
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
75
            "``breezy.merge.AbstractPerFileMerger``. "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
76
            "Such objects will then be called per file "
77
            "that needs to be merged (including when one "
78
            "side has deleted the file and the other has changed it). "
79
            "See the AbstractPerFileMerger API docs for details on how it is "
80
            "used by merge.",
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
81
            (2, 1))
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
82
        self.add_hook('pre_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
83
            'Called before a merge. '
84
            'Receives a Merger object as the single argument.',
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
85
            (2, 5))
86
        self.add_hook('post_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
87
            'Called after a merge. '
88
            'Receives a Merger object as the single argument. '
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
89
            'The return value is ignored.',
90
            (2, 5))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
91
92
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
93
class AbstractPerFileMerger(object):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
94
    """PerFileMerger objects are used by plugins extending merge for breezy.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
95
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
96
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
97
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
98
    :ivar merger: The Merge3Merger performing the merge.
99
    """
100
101
    def __init__(self, merger):
102
        """Create a PerFileMerger for use with merger."""
103
        self.merger = merger
104
105
    def merge_contents(self, merge_params):
106
        """Attempt to merge the contents of a single file.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
107
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
108
        :param merge_params: A breezy.merge.MergeFileHookParams
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
109
        :return: A tuple of (status, chunks), where status is one of
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
110
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
111
            is 'success' or 'conflicted', then chunks should be an iterable of
112
            strings for the new file contents.
113
        """
114
        return ('not applicable', None)
115
116
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
117
class PerFileMerger(AbstractPerFileMerger):
118
    """Merge individual files when self.file_matches returns True.
119
120
    This class is intended to be subclassed.  The file_matches and
121
    merge_matching methods should be overridden with concrete implementations.
122
    """
123
124
    def file_matches(self, params):
125
        """Return True if merge_matching should be called on this file.
126
127
        Only called with merges of plain files with no clear winner.
128
129
        Subclasses must override this.
130
        """
131
        raise NotImplementedError(self.file_matches)
132
133
    def merge_contents(self, params):
134
        """Merge the contents of a single file."""
135
        # Check whether this custom merge logic should be used.
136
        if (
137
            # OTHER is a straight winner, rely on default merge.
138
            params.winner == 'other' or
139
            # THIS and OTHER aren't both files.
140
            not params.is_file_merge() or
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
141
            # The filename doesn't match
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
142
            not self.file_matches(params)):
143
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
144
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
145
146
    def merge_matching(self, params):
147
        """Merge the contents of a single file that has matched the criteria
148
        in PerFileMerger.merge_contents (is a conflict, is a file,
149
        self.file_matches is True).
150
151
        Subclasses must override this.
152
        """
153
        raise NotImplementedError(self.merge_matching)
154
155
156
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
157
    """Merge individual files when configured via a .conf file.
158
159
    This is a base class for concrete custom file merging logic. Concrete
160
    classes should implement ``merge_text``.
161
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
162
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
163
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
164
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
165
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
166
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
167
        details. <name_prefix>_merge_files describes the files targeted by the
168
        hook for example.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
169
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
170
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
171
        is present.
172
    """
173
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
174
    name_prefix = None
175
    default_files = None
176
177
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
178
        super(ConfigurableFileMerger, self).__init__(merger)
179
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
180
        self.default_files = self.__class__.default_files or []
181
        self.name_prefix = self.__class__.name_prefix
182
        if self.name_prefix is None:
183
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
184
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
185
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
186
        """Check whether the file should call the merge hook.
187
188
        <name_prefix>_merge_files configuration variable is a list of files
189
        that should use the hook.
190
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
191
        affected_files = self.affected_files
192
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
193
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
194
            # Until bzr provides a better policy for caching the config, we
195
            # just add the part we're interested in to the params to avoid
6740.1.1 by Jelmer Vernooij
Rename bazaar.conf to breezy.conf.
196
            # reading the config files repeatedly (breezy.conf, location.conf,
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
197
            # branch.conf).
198
            config_key = self.name_prefix + '_merge_files'
199
            affected_files = config.get_user_option_as_list(config_key)
200
            if affected_files is None:
201
                # If nothing was specified in the config, use the default.
202
                affected_files = self.default_files
203
            self.affected_files = affected_files
204
        if affected_files:
6883.10.1 by Jelmer Vernooij
Fix more tets.
205
            filepath = params.this_path
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
206
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
207
                return True
208
        return False
209
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
210
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
211
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
212
213
    def merge_text(self, params):
214
        """Merge the byte contents of a single file.
215
216
        This is called after checking that the merge should be performed in
217
        merge_contents, and it should behave as per
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
218
        ``breezy.merge.AbstractPerFileMerger.merge_contents``.
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
219
        """
220
        raise NotImplementedError(self.merge_text)
221
222
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
223
class MergeFileHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
224
    """Object holding parameters passed to merge_file_content hooks.
225
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
226
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
227
228
    :ivar file_id: the file ID of the file being merged
6883.10.1 by Jelmer Vernooij
Fix more tets.
229
    :ivar base_path: Path in base tree
230
    :ivar other_path: Path in other tree
231
    :ivar this_path: Path in this tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
232
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
233
    :ivar this_kind: kind of file_id in 'this' tree
234
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
235
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
236
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
237
6883.10.1 by Jelmer Vernooij
Fix more tets.
238
    def __init__(self, merger, file_id, paths, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
239
            winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
240
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
241
        self.file_id = file_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
242
        self.paths = paths
243
        self.base_path, self.other_path, self.this_path = paths
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
244
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
245
        self.this_kind = this_kind
246
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
247
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
248
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
249
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
250
        """True if this_kind and other_kind are both 'file'."""
251
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
252
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
253
    @decorators.cachedproperty
254
    def base_lines(self):
255
        """The lines of the 'base' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
256
        return self._merger.get_lines(self._merger.base_tree, self.base_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
257
258
    @decorators.cachedproperty
259
    def this_lines(self):
260
        """The lines of the 'this' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
261
        return self._merger.get_lines(self._merger.this_tree, self.this_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
262
263
    @decorators.cachedproperty
264
    def other_lines(self):
265
        """The lines of the 'other' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
266
        return self._merger.get_lines(self._merger.other_tree, self.other_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
267
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
268
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
269
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
270
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
271
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
272
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
273
    def __init__(self, this_branch, other_tree=None, base_tree=None,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
274
                 this_tree=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
275
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
276
        object.__init__(self)
277
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
278
        self.this_basis = _mod_revision.ensure_null(
279
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
280
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
281
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
282
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
283
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
284
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
285
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
286
        self.base_tree = base_tree
287
        self.ignore_zero = False
288
        self.backup_files = False
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
289
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
290
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
291
        self.reprocess = False
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
292
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
293
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
294
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
295
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
296
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
297
        self._base_is_ancestor = None
298
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
299
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
300
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
301
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
302
    def cache_trees_with_revision_ids(self, trees):
303
        """Cache any tree in trees if it has a revision_id."""
304
        for maybe_tree in trees:
305
            if maybe_tree is None:
306
                continue
307
            try:
308
                rev_id = maybe_tree.get_revision_id()
309
            except AttributeError:
310
                continue
311
            self._cached_trees[rev_id] = maybe_tree
312
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
313
    @property
314
    def revision_graph(self):
315
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
316
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
317
        return self._revision_graph
318
319
    def _set_base_is_ancestor(self, value):
320
        self._base_is_ancestor = value
321
322
    def _get_base_is_ancestor(self):
323
        if self._base_is_ancestor is None:
324
            self._base_is_ancestor = self.revision_graph.is_ancestor(
325
                self.base_rev_id, self.this_basis)
326
        return self._base_is_ancestor
327
328
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
329
330
    def _set_base_is_other_ancestor(self, value):
331
        self._base_is_other_ancestor = value
332
333
    def _get_base_is_other_ancestor(self):
334
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
335
            if self.other_basis is None:
336
                return True
337
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
338
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
339
        return self._base_is_other_ancestor
340
341
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
342
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
343
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
344
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
345
    def from_uncommitted(tree, other_tree, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
346
        """Return a Merger for uncommitted changes in other_tree.
347
348
        :param tree: The tree to merge into
349
        :param other_tree: The tree to get uncommitted changes from
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
350
        :param base_tree: The basis to use for the merge.  If unspecified,
351
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
352
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
353
        if base_tree is None:
354
            base_tree = other_tree.basis_tree()
6719.1.2 by Jelmer Vernooij
Fix some tests.
355
        merger = Merger(tree.branch, other_tree, base_tree, tree)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
356
        merger.base_rev_id = merger.base_tree.get_revision_id()
357
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
358
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
359
        return merger
360
361
    @classmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
362
    def from_mergeable(klass, tree, mergeable):
1551.15.74 by Aaron Bentley
Textual updates from review
363
        """Return a Merger for a bundle or merge directive.
364
365
        :param tree: The tree to merge changes into
366
        :param mergeable: A merge directive or bundle
367
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
368
        mergeable.install_revisions(tree.branch.repository)
369
        base_revision_id, other_revision_id, verified =\
370
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
371
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
372
        if base_revision_id is not None:
373
            if (base_revision_id != _mod_revision.NULL_REVISION and
374
                revision_graph.is_ancestor(
375
                base_revision_id, tree.branch.last_revision())):
376
                base_revision_id = None
377
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
378
                trace.warning('Performing cherrypick')
6719.1.2 by Jelmer Vernooij
Fix some tests.
379
        merger = klass.from_revision_ids(tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
380
                                         base_revision_id, revision_graph=
381
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
382
        return merger, verified
383
384
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
385
    def from_revision_ids(tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
386
                          base_branch=None, revision_graph=None,
387
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
388
        """Return a Merger for revision-ids.
389
390
        :param tree: The tree to merge changes into
391
        :param other: The revision-id to use as OTHER
392
        :param base: The revision-id to use as BASE.  If not specified, will
393
            be auto-selected.
394
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
395
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
396
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
397
            not supplied, other_branch or tree.branch will be used.
398
        :param revision_graph: If you have a revision_graph precomputed, pass
399
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
400
        :param tree_branch: The branch associated with tree.  If not supplied,
401
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
402
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
403
        if tree_branch is None:
404
            tree_branch = tree.branch
6719.1.2 by Jelmer Vernooij
Fix some tests.
405
        merger = Merger(tree_branch, this_tree=tree,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
406
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
407
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
408
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
409
        merger.set_other_revision(other, other_branch)
410
        if base is None:
411
            merger.find_base()
412
        else:
413
            if base_branch is None:
414
                base_branch = other_branch
415
            merger.set_base_revision(base, base_branch)
416
        return merger
417
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
418
    def revision_tree(self, revision_id, branch=None):
419
        if revision_id not in self._cached_trees:
420
            if branch is None:
421
                branch = self.this_branch
422
            try:
423
                tree = self.this_tree.revision_tree(revision_id)
424
            except errors.NoSuchRevisionInTree:
425
                tree = branch.repository.revision_tree(revision_id)
426
            self._cached_trees[revision_id] = tree
427
        return self._cached_trees[revision_id]
428
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
429
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
430
        location, revno = treespec
431
        if revno is None:
432
            tree = workingtree.WorkingTree.open_containing(location)[0]
433
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
434
        branch = _mod_branch.Branch.open_containing(
435
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
436
        if revno == -1:
437
            revision_id = branch.last_revision()
438
        else:
439
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
440
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
441
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
442
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
443
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
444
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
445
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
446
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
447
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
448
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
449
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
450
        self._add_parent()
451
452
    def _add_parent(self):
453
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
454
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
455
        operation = cleanup.OperationWithCleanups(
456
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
457
        for revision_id in new_parents:
458
            try:
459
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
460
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
461
                tree = None
462
            else:
463
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
464
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
465
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
466
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
467
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
468
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
469
        """Set the revision and tree to merge from.
470
471
        This sets the other_tree, other_rev_id, other_basis attributes.
472
473
        :param other_revision: The [path, revision] list to merge from.
474
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
475
        self.other_branch, self.other_tree = self._get_tree(other_revision,
476
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
477
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
478
            self.other_rev_id = _mod_revision.ensure_null(
479
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
480
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
481
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
482
            self.other_basis = self.other_rev_id
483
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
484
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
485
            self.other_basis = self.other_rev_id
486
        else:
487
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
488
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
489
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
490
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
491
        if self.other_rev_id is not None:
492
            self._cached_trees[self.other_rev_id] = self.other_tree
6388.1.2 by Jelmer Vernooij
Fix formatting.
493
        self._maybe_fetch(self.other_branch, self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
494
2100.3.29 by Aaron Bentley
Get merge working initially
495
    def set_other_revision(self, revision_id, other_branch):
496
        """Set 'other' based on a branch and revision id
497
498
        :param revision_id: The revision to use for a tree
499
        :param other_branch: The branch containing this tree
500
        """
501
        self.other_rev_id = revision_id
502
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
503
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
504
        self.other_tree = self.revision_tree(revision_id)
505
        self.other_basis = revision_id
506
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
507
    def set_base_revision(self, revision_id, branch):
508
        """Set 'base' based on a branch and revision id
509
510
        :param revision_id: The revision to use for a tree
511
        :param branch: The branch containing this tree
512
        """
513
        self.base_rev_id = revision_id
514
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
515
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
516
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
517
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
518
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
519
        if not source.repository.has_same_location(target.repository):
5741.1.9 by Jelmer Vernooij
Remove fetch_tags argument.
520
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
521
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
522
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
523
        revisions = [_mod_revision.ensure_null(self.this_basis),
524
                     _mod_revision.ensure_null(self.other_basis)]
525
        if _mod_revision.NULL_REVISION in revisions:
526
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
527
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
528
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
529
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
530
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
531
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
532
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
533
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
534
            elif len(lcas) == 1:
535
                self.base_rev_id = list(lcas)[0]
536
            else: # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
537
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
538
                if len(lcas) > 2:
539
                    # find_unique_lca can only handle 2 nodes, so we have to
540
                    # start back at the beginning. It is a shame to traverse
541
                    # the graph again, but better than re-implementing
542
                    # find_unique_lca.
543
                    self.base_rev_id = self.revision_graph.find_unique_lca(
544
                                            revisions[0], revisions[1])
545
                else:
546
                    self.base_rev_id = self.revision_graph.find_unique_lca(
547
                                            *lcas)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
548
                sorted_lca_keys = self.revision_graph.find_merge_order(
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
549
                    revisions[0], lcas)
550
                if self.base_rev_id == _mod_revision.NULL_REVISION:
551
                    self.base_rev_id = sorted_lca_keys[0]
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
552
4721.3.1 by Vincent Ladeuil
Cleanup imports.
553
            if self.base_rev_id == _mod_revision.NULL_REVISION:
554
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
555
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
556
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
557
                              ' help criss-cross.')
558
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
559
                if self.base_rev_id in lcas:
560
                    trace.mutter('Unable to find unique lca. '
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
561
                                 'Fallback %r as best option.'
562
                                 % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
563
                interesting_revision_ids = set(lcas)
564
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
565
                interesting_trees = dict((t.get_revision_id(), t)
566
                    for t in self.this_branch.repository.revision_trees(
567
                        interesting_revision_ids))
568
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
569
                if self.base_rev_id in lcas:
570
                    self.base_tree = interesting_trees[self.base_rev_id]
571
                else:
572
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
573
                self._lca_trees = [interesting_trees[key]
574
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
575
            else:
576
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
577
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
578
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
579
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
580
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
581
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
582
        """Set the base revision to use for the merge.
583
584
        :param base_revision: A 2-list containing a path and revision number.
585
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
586
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
587
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
588
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
589
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
590
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
591
            if base_revision[1] == -1:
592
                self.base_rev_id = base_branch.last_revision()
593
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
594
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
595
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
596
                self.base_rev_id = _mod_revision.ensure_null(
597
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
598
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
599
3008.1.8 by Michael Hudson
extract merger creation into a method
600
    def make_merger(self):
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
601
        kwargs = {'working_tree': self.this_tree, 'this_tree': self.this_tree,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
602
                  'other_tree': self.other_tree,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
603
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
604
                  'this_branch': self.this_branch,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
605
                  'other_branch': self.other_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
606
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
607
        if self.merge_type.requires_base:
608
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
609
        if self.merge_type.supports_reprocess:
610
            kwargs['reprocess'] = self.reprocess
611
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
612
            raise errors.BzrError(
613
                "Conflict reduction is not supported for merge"
614
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
615
        if self.merge_type.supports_show_base:
616
            kwargs['show_base'] = self.show_base
617
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
618
            raise errors.BzrError("Showing base is not supported for this"
619
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
620
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
621
            and not self.base_is_other_ancestor):
622
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
623
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
624
            kwargs['cherrypick'] = (not self.base_is_ancestor or
625
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
626
        if self._is_criss_cross and getattr(self.merge_type,
627
                                            'supports_lca_trees', False):
628
            kwargs['lca_trees'] = self._lca_trees
6719.1.2 by Jelmer Vernooij
Fix some tests.
629
        return self.merge_type(change_reporter=self.change_reporter,
3008.1.8 by Michael Hudson
extract merger creation into a method
630
                               **kwargs)
631
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
632
    def _do_merge_to(self):
633
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
634
        if self.other_branch is not None:
635
            self.other_branch.update_references(self.this_branch)
6388.1.4 by Jelmer Vernooij
Fix tests.
636
        for hook in Merger.hooks['pre_merge']:
637
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
638
        merge.do_merge()
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
639
        for hook in Merger.hooks['post_merge']:
640
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
641
        if self.recurse == 'down':
642
            for relpath, file_id in self.this_tree.iter_references():
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
643
                sub_tree = self.this_tree.get_nested_tree(relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
644
                other_revision = self.other_tree.get_reference_revision(
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
645
                    relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
646
                if  other_revision == sub_tree.last_revision():
647
                    continue
648
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
649
                sub_merge.merge_type = self.merge_type
6926.2.5 by Jelmer Vernooij
Swap order for nested tree functions.
650
                other_branch = self.other_branch.reference_parent(
651
                    relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
652
                sub_merge.set_other_revision(other_revision, other_branch)
6883.5.3 by Jelmer Vernooij
Add find_previous_path.
653
                base_tree_path = _mod_tree.find_previous_path(
654
                    self.this_tree, self.base_tree, relpath)
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
655
                base_revision = self.base_tree.get_reference_revision(
656
                    base_tree_path, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
657
                sub_merge.base_tree = \
658
                    sub_tree.branch.repository.revision_tree(base_revision)
659
                sub_merge.base_rev_id = base_revision
660
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
661
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
662
3008.1.8 by Michael Hudson
extract merger creation into a method
663
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
664
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
665
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
666
        operation.add_cleanup(self.this_tree.unlock)
667
        if self.base_tree is not None:
668
            self.base_tree.lock_read()
669
            operation.add_cleanup(self.base_tree.unlock)
670
        if self.other_tree is not None:
671
            self.other_tree.lock_read()
672
            operation.add_cleanup(self.other_tree.unlock)
673
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
674
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
675
            if not self.ignore_zero and not trace.is_quiet():
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
676
                trace.note(gettext("All changes applied successfully."))
1534.7.141 by Aaron Bentley
Added conflict reporting
677
        else:
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
678
            trace.note(gettext("%d conflicts encountered.")
4721.3.1 by Vincent Ladeuil
Cleanup imports.
679
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
680
1534.7.134 by Aaron Bentley
Hid raw conflicts
681
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
682
1545.2.4 by Aaron Bentley
PEP8 fixes
683
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
684
class _InventoryNoneEntry(object):
685
    """This represents an inventory entry which *isn't there*.
686
687
    It simplifies the merging logic if we always have an InventoryEntry, even
688
    if it isn't actually present
689
    """
690
    executable = None
691
    kind = None
692
    name = None
693
    parent_id = None
694
    revision = None
695
    symlink_target = None
696
    text_sha1 = None
697
698
_none_entry = _InventoryNoneEntry()
699
700
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
701
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
702
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
703
    requires_base = True
704
    supports_reprocess = True
705
    supports_show_base = True
706
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
707
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
708
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
709
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
710
    supports_lca_trees = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
711
    requires_file_merge_plan = False
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
712
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
713
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
714
                 reprocess=False, show_base=False,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
715
                 change_reporter=None, interesting_files=None, do_merge=True,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
716
                 cherrypick=False, lca_trees=None, this_branch=None,
717
                 other_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
718
        """Initialize the merger object and perform the merge.
719
720
        :param working_tree: The working tree to apply the merge to
721
        :param this_tree: The local tree in the merge operation
722
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
723
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
724
        :param this_branch: The branch associated with this_tree.  Defaults to
725
            this_tree.branch if not supplied.
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
726
        :param other_branch: The branch associated with other_tree, if any.
2590.2.10 by Aaron Bentley
Updates from review
727
        :param: reprocess If True, perform conflict-reduction processing.
728
        :param show_base: If True, show the base revision in text conflicts.
729
            (incompatible with reprocess)
730
        :param change_reporter: An object that should report changes made
731
        :param interesting_files: The tree-relative paths of files that should
732
            participate in the merge.  If these paths refer to directories,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
733
            the contents of those directories will also be included.  If not
734
            specified, all files may participate in the
2590.2.10 by Aaron Bentley
Updates from review
735
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
736
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
737
            if the ancestry was found to include a criss-cross merge.
738
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
739
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
740
        object.__init__(self)
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
741
        if this_branch is None:
742
            this_branch = this_tree.branch
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
743
        self.interesting_files = interesting_files
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
744
        self.working_tree = working_tree
745
        self.this_tree = this_tree
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
746
        self.base_tree = base_tree
747
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
748
        self.this_branch = this_branch
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
749
        self.other_branch = other_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
750
        self._raw_conflicts = []
751
        self.cooked_conflicts = []
752
        self.reprocess = reprocess
753
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
754
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
755
        # Uncommenting this will change the default algorithm to always use
756
        # _entries_lca. This can be useful for running the test suite and
757
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
758
        # if lca_trees is None:
759
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
760
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
761
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
762
        if do_merge:
763
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
764
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
765
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
766
        operation = cleanup.OperationWithCleanups(self._do_merge)
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
767
        self.working_tree.lock_tree_write()
768
        operation.add_cleanup(self.working_tree.unlock)
769
        self.this_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
770
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
771
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
772
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
773
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
774
        operation.add_cleanup(self.other_tree.unlock)
775
        operation.run()
776
777
    def _do_merge(self, operation):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
778
        self.tt = transform.TreeTransform(self.working_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
779
        operation.add_cleanup(self.tt.finalize)
780
        self._compute_transform()
781
        results = self.tt.apply(no_conflicts=True)
782
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
783
        try:
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
784
            self.working_tree.add_conflicts(self.cooked_conflicts)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
785
        except errors.UnsupportedOperation:
786
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
787
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
788
    def make_preview_transform(self):
7058.4.25 by Jelmer Vernooij
Use contexts.
789
        with self.base_tree.lock_read(), self.other_tree.lock_read():
790
            self.tt = transform.TransformPreview(self.working_tree)
791
            self._compute_transform()
792
            return self.tt
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
793
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
794
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
795
        if self._lca_trees is None:
796
            entries = self._entries3()
797
            resolver = self._three_way
798
        else:
799
            entries = self._entries_lca()
800
            resolver = self._lca_multi_way
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
801
        # Prepare merge hooks
802
        factories = Merger.hooks['merge_file_content']
803
        # One hook for each registered one plus our default merger
804
        hooks = [factory(self) for factory in factories] + [self]
805
        self.active_hooks = [hook for hook in hooks if hook is not None]
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
806
        with ui.ui_factory.nested_progress_bar() as child_pb:
6883.10.1 by Jelmer Vernooij
Fix more tets.
807
            for num, (file_id, changed, paths3, parents3, names3,
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
808
                      executable3) in enumerate(entries):
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
809
                # Try merging each entry
810
                child_pb.update(gettext('Preparing file merge'),
811
                                num, len(entries))
6883.10.1 by Jelmer Vernooij
Fix more tets.
812
                self._merge_names(file_id, paths3, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
813
                if changed:
6883.10.1 by Jelmer Vernooij
Fix more tets.
814
                    file_status = self._do_merge_contents(paths3, file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
815
                else:
816
                    file_status = 'unmodified'
6883.10.1 by Jelmer Vernooij
Fix more tets.
817
                self._merge_executable(paths3, file_id, executable3,
818
                        file_status, resolver=resolver)
5993.2.4 by Jelmer Vernooij
Remove feature flag.
819
        self.tt.fixup_new_roots()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
820
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
821
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
822
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
823
        """Finalize the transform and report the changes.
824
825
        This is the second half of _compute_transform.
826
        """
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
827
        with ui.ui_factory.nested_progress_bar() as child_pb:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
828
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
829
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
830
        if self.change_reporter is not None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
831
            from breezy import delta
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
832
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
833
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
834
        self.cook_conflicts(fs_conflicts)
835
        for conflict in self.cooked_conflicts:
6973.6.4 by Jelmer Vernooij
Avoid text_type()
836
            trace.warning('%s', conflict.describe())
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
837
2590.2.4 by Aaron Bentley
Move entry generation to a helper
838
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
839
        """Gather data about files modified between three trees.
840
841
        Return a list of tuples of file_id, changed, parents3, names3,
842
        executable3.  changed is a boolean indicating whether the file contents
843
        or kind were changed.  parents3 is a tuple of parent ids for base,
844
        other and this.  names3 is a tuple of names for base, other and this.
845
        executable3 is a tuple of execute-bit values for base, other and this.
846
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
847
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
848
        iterator = self.other_tree.iter_changes(self.base_tree,
5783.2.1 by John Arbash Meinel
Remove the 'include_unchanged=True' from iter_changes.
849
                specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
850
                extra_trees=[self.this_tree])
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
851
        this_interesting_files = self.this_tree.find_related_paths_across_trees(
852
                self.interesting_files, trees=[self.other_tree])
6883.10.1 by Jelmer Vernooij
Fix more tets.
853
        this_entries = dict(self.this_tree.iter_entries_by_dir(
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
854
                            specific_files=this_interesting_files))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
855
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
856
             executable) in iterator:
6883.10.2 by Jelmer Vernooij
Resolve TODO
857
            if paths[0] is not None:
858
                this_path = _mod_tree.find_previous_path(
859
                        self.base_tree, self.this_tree, paths[0])
6883.10.1 by Jelmer Vernooij
Fix more tets.
860
            else:
6883.10.2 by Jelmer Vernooij
Resolve TODO
861
                this_path = _mod_tree.find_previous_path(
862
                        self.other_tree, self.this_tree, paths[1])
863
            this_entry = this_entries.get(this_path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
864
            if this_entry is not None:
865
                this_name = this_entry.name
866
                this_parent = this_entry.parent_id
867
                this_executable = this_entry.executable
2590.2.4 by Aaron Bentley
Move entry generation to a helper
868
            else:
869
                this_name = None
870
                this_parent = None
871
                this_executable = None
872
            parents3 = parents + (this_parent,)
873
            names3 = names + (this_name,)
6883.10.1 by Jelmer Vernooij
Fix more tets.
874
            paths3 = paths + (this_path, )
2590.2.4 by Aaron Bentley
Move entry generation to a helper
875
            executable3 = executable + (this_executable,)
6883.10.1 by Jelmer Vernooij
Fix more tets.
876
            result.append((file_id, changed, paths3, parents3, names3, executable3))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
877
        return result
878
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
879
    def _entries_lca(self):
880
        """Gather data about files modified between multiple trees.
881
882
        This compares OTHER versus all LCA trees, and for interesting entries,
883
        it then compares with THIS and BASE.
884
885
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
886
6883.10.1 by Jelmer Vernooij
Fix more tets.
887
        :return: [(file_id, changed, paths, parents, names, executable)], where:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
888
889
            * file_id: Simple file_id of the entry
890
            * changed: Boolean, True if the kind or contents changed else False
6883.10.1 by Jelmer Vernooij
Fix more tets.
891
            * paths: ((base, [path, in, lcas]), path_other, path_this)
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
892
            * parents: ((base, [parent_id, in, lcas]), parent_id_other,
893
                        parent_id_this)
894
            * names:   ((base, [name, in, lcas]), name_in_other, name_in_this)
895
            * executable: ((base, [exec, in, lcas]), exec_in_other,
896
                        exec_in_this)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
897
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
898
        if self.interesting_files is not None:
899
            lookup_trees = [self.this_tree, self.base_tree]
900
            lookup_trees.extend(self._lca_trees)
901
            # I think we should include the lca trees as well
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
902
            interesting_files = self.other_tree.find_related_paths_across_trees(
903
                    self.interesting_files, lookup_trees)
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
904
        else:
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
905
            interesting_files = None
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
906
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
907
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
908
6405.2.10 by Jelmer Vernooij
Fix more tests.
909
        base_inventory = self.base_tree.root_inventory
910
        this_inventory = self.this_tree.root_inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
911
        for path, file_id, other_ie, lca_values in walker.iter_all():
912
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
913
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
914
                other_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
915
                other_path = None
916
            else:
917
                other_path = self.other_tree.id2path(file_id)
6883.10.3 by Jelmer Vernooij
Merge trunk.
918
            if interesting_files is not None and other_path not in interesting_files:
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
919
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
920
3514.4.30 by John Arbash Meinel
Several updates.
921
            # If other_revision is found in any of the lcas, that means this
922
            # node is uninteresting. This is because when merging, if there are
923
            # multiple heads(), we have to create a new node. So if we didn't,
924
            # we know that the ancestry is linear, and that OTHER did not
925
            # modify anything
926
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
927
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
928
            if other_revision is not None:
929
                # We can't use this shortcut when other_revision is None,
930
                # because it may be None because things are WorkingTrees, and
931
                # not because it is *actually* None.
932
                is_unmodified = False
933
                for lca_path, ie in lca_values:
934
                    if ie is not None and ie.revision == other_revision:
935
                        is_unmodified = True
936
                        break
937
                if is_unmodified:
938
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
939
940
            lca_entries = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
941
            lca_paths = []
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
942
            for lca_path, lca_ie in lca_values:
943
                if lca_ie is None:
944
                    lca_entries.append(_none_entry)
6883.10.1 by Jelmer Vernooij
Fix more tets.
945
                    lca_paths.append(None)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
946
                else:
947
                    lca_entries.append(lca_ie)
6928.1.2 by Jelmer Vernooij
Fix path specification.
948
                    lca_paths.append(lca_path)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
949
6883.7.12 by Jelmer Vernooij
avoid has_id.
950
            try:
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
951
                base_ie = base_inventory.get_entry(file_id)
6883.7.12 by Jelmer Vernooij
avoid has_id.
952
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
953
                base_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
954
                base_path = None
955
            else:
956
                base_path = self.base_tree.id2path(file_id)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
957
6883.7.12 by Jelmer Vernooij
avoid has_id.
958
            try:
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
959
                this_ie = this_inventory.get_entry(file_id)
6883.7.12 by Jelmer Vernooij
avoid has_id.
960
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
961
                this_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
962
                this_path = None
963
            else:
964
                this_path = self.this_tree.id2path(file_id)
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
965
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
966
            lca_kinds = []
967
            lca_parent_ids = []
968
            lca_names = []
969
            lca_executable = []
970
            for lca_ie in lca_entries:
971
                lca_kinds.append(lca_ie.kind)
972
                lca_parent_ids.append(lca_ie.parent_id)
973
                lca_names.append(lca_ie.name)
974
                lca_executable.append(lca_ie.executable)
975
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
976
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
977
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
978
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
979
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
980
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
981
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
982
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
983
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
984
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
985
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
986
            content_changed = True
987
            if kind_winner == 'this':
988
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
989
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
990
                    if parent_id_winner == 'this' and name_winner == 'this':
991
                        # No change for this directory in OTHER, skip
992
                        continue
993
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
994
                elif other_ie.kind is None or other_ie.kind == 'file':
6883.10.1 by Jelmer Vernooij
Fix more tets.
995
                    def get_sha1(tree, path):
996
                        if path is None:
997
                            return None
998
                        try:
999
                            return tree.get_file_sha1(path, file_id)
1000
                        except errors.NoSuchFile:
1001
                            return None
1002
                    base_sha1 = get_sha1(self.base_tree, base_path)
6928.1.2 by Jelmer Vernooij
Fix path specification.
1003
                    lca_sha1s = [get_sha1(tree, lca_path)
1004
                                 for tree, lca_path
6883.10.1 by Jelmer Vernooij
Fix more tets.
1005
                                 in zip(self._lca_trees, lca_paths)]
1006
                    this_sha1 = get_sha1(self.this_tree, this_path)
1007
                    other_sha1 = get_sha1(self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1008
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1009
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1010
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1011
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1012
                        (base_ie.executable, lca_executable),
1013
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1014
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1015
                        and sha1_winner == 'this' and exec_winner == 'this'):
1016
                        # No kind, parent, name, exec, or content change for
1017
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1018
                        continue
1019
                    if sha1_winner == 'this':
1020
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1021
                elif other_ie.kind == 'symlink':
6883.10.1 by Jelmer Vernooij
Fix more tets.
1022
                    def get_target(ie, tree, path):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1023
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1024
                            return None
6809.4.21 by Jelmer Vernooij
Fix long lines.
1025
                        return tree.get_symlink_target(path, file_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1026
                    base_target = get_target(base_ie, self.base_tree, base_path)
1027
                    lca_targets = [get_target(ie, tree, lca_path) for ie, tree, lca_path
1028
                                   in zip(lca_entries, self._lca_trees, lca_paths)]
1029
                    this_target = get_target(this_ie, self.this_tree, this_path)
1030
                    other_target = get_target(other_ie, self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1031
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1032
                        (base_target, lca_targets),
1033
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1034
                    if (parent_id_winner == 'this' and name_winner == 'this'
1035
                        and target_winner == 'this'):
1036
                        # No kind, parent, name, or symlink target change
1037
                        # not interesting
1038
                        continue
1039
                    if target_winner == 'this':
1040
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1041
                elif other_ie.kind == 'tree-reference':
1042
                    # The 'changed' information seems to be handled at a higher
1043
                    # level. At least, _entries3 returns False for content
1044
                    # changed, even when at a new revision_id.
1045
                    content_changed = False
1046
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1047
                        # Nothing interesting
1048
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1049
                else:
1050
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1051
1052
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1053
            result.append((file_id, content_changed,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1054
                           ((base_path, lca_paths),
1055
                            other_path, this_path),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1056
                           ((base_ie.parent_id, lca_parent_ids),
1057
                            other_ie.parent_id, this_ie.parent_id),
1058
                           ((base_ie.name, lca_names),
1059
                            other_ie.name, this_ie.name),
1060
                           ((base_ie.executable, lca_executable),
1061
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1062
                          ))
1063
        return result
1064
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1065
    def write_modified(self, results):
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1066
        if not self.working_tree.supports_merge_modified():
1067
            return
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1068
        modified_hashes = {}
1069
        for path in results.modified_paths:
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1070
            wt_relpath = self.working_tree.relpath(path)
1071
            file_id = self.working_tree.path2id(wt_relpath)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1072
            if file_id is None:
1073
                continue
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1074
            hash = self.working_tree.get_file_sha1(wt_relpath, file_id)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1075
            if hash is None:
1076
                continue
1077
            modified_hashes[file_id] = hash
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1078
        self.working_tree.set_merge_modified(modified_hashes)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1079
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1080
    @staticmethod
1081
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1082
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1083
        if entry is None:
1084
            return None
1085
        return entry.parent_id
1086
1087
    @staticmethod
1088
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1089
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1090
        if entry is None:
1091
            return None
1092
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1093
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1094
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1095
    def contents_sha1(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1096
        """Determine the sha1 of the file contents (used as a key method)."""
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1097
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1098
            return tree.get_file_sha1(path, file_id)
1099
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1100
            return None
1101
1102
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1103
    def executable(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1104
        """Determine the executability of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1105
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1106
            if tree.kind(path, file_id) != "file":
1107
                return False
1108
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1109
            return None
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1110
        return tree.is_executable(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1111
1112
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1113
    def kind(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1114
        """Determine the kind of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1115
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1116
            return tree.kind(path, file_id)
1117
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1118
            return None
1119
1120
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1121
    def _three_way(base, other, this):
1122
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1123
            # if 'base == other', either they all agree, or only 'this' has
1124
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1125
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1126
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1127
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1128
            return 'conflict'
1129
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1130
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1131
            return "this"
1132
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1133
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1134
            return "other"
1135
1136
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1137
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1138
        """Consider LCAs when determining whether a change has occurred.
1139
1140
        If LCAS are all identical, this is the same as a _three_way comparison.
1141
1142
        :param bases: value in (BASE, [LCAS])
1143
        :param other: value in OTHER
1144
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1145
        :param allow_overriding_lca: If there is more than one unique lca
1146
            value, allow OTHER to override THIS if it has a new value, and
1147
            THIS only has an lca value, or vice versa. This is appropriate for
1148
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1149
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1150
            changed or not.
1151
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1152
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1153
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1154
        if other == this:
1155
            # Either Ambiguously clean, or nothing was actually changed. We
1156
            # don't really care
1157
            return 'this'
1158
        base_val, lca_vals = bases
1159
        # Remove 'base_val' from the lca_vals, because it is not interesting
1160
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1161
                                      if lca_val != base_val]
1162
        if len(filtered_lca_vals) == 0:
1163
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1164
1165
        unique_lca_vals = set(filtered_lca_vals)
1166
        if len(unique_lca_vals) == 1:
1167
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1168
1169
        if allow_overriding_lca:
1170
            if other in unique_lca_vals:
1171
                if this in unique_lca_vals:
1172
                    # Each side picked a different lca, conflict
1173
                    return 'conflict'
1174
                else:
1175
                    # This has a value which supersedes both lca values, and
1176
                    # other only has an lca value
1177
                    return 'this'
1178
            elif this in unique_lca_vals:
1179
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1180
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1181
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1182
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1183
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1184
        return 'conflict'
1185
6883.22.13 by Jelmer Vernooij
Actually pass in None file-ids to BranchBuilder.
1186
    def merge_names(self, paths):
1187
        def get_entry(tree, path):
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1188
            try:
6883.22.13 by Jelmer Vernooij
Actually pass in None file-ids to BranchBuilder.
1189
                return next(tree.iter_entries_by_dir(specific_files=[path]))[1]
1190
            except StopIteration:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1191
                return None
6883.22.13 by Jelmer Vernooij
Actually pass in None file-ids to BranchBuilder.
1192
        used_base_path, other_path, this_path = paths
1193
        this_entry = get_entry(self.this_tree, this_path)
1194
        other_entry = get_entry(self.other_tree, other_path)
1195
        base_entry = get_entry(self.base_tree, base_path)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1196
        entries = (base_entry, other_entry, this_entry)
1197
        names = []
1198
        parents = []
1199
        for entry in entries:
1200
            if entry is None:
1201
                names.append(None)
1202
                parents.append(None)
1203
            else:
1204
                names.append(entry.name)
1205
                parents.append(entry.parent_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1206
        return self._merge_names(file_id, paths, parents, names,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1207
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1208
6883.10.1 by Jelmer Vernooij
Fix more tets.
1209
    def _merge_names(self, file_id, paths, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1210
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1211
        base_name, other_name, this_name = names
1212
        base_parent, other_parent, this_parent = parents
6883.10.1 by Jelmer Vernooij
Fix more tets.
1213
        unused_base_path, other_path, this_path = paths
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1214
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1215
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1216
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1217
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1218
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1219
            if name_winner == "this":
1220
                name_winner = "other"
1221
            if parent_id_winner == "this":
1222
                parent_id_winner = "other"
1223
        if name_winner == "this" and parent_id_winner == "this":
1224
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1225
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1226
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1227
            # road if a ContentConflict needs to be created so we should not do
1228
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1229
            trans_id = self.tt.trans_id_file_id(file_id)
1230
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1231
                                        this_parent, this_name,
1232
                                        other_parent, other_name))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1233
        if other_path is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1234
            # it doesn't matter whether the result was 'other' or
5954.4.6 by Aaron Bentley
Updates from review.
1235
            # 'conflict'-- if it has no file id, we leave it alone.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1236
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1237
        parent_id = parents[self.winner_idx[parent_id_winner]]
5954.4.2 by Aaron Bentley
Support merging into null tree.
1238
        name = names[self.winner_idx[name_winner]]
1239
        if parent_id is not None or name is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1240
            # if we get here, name_winner and parent_winner are set to safe
1241
            # values.
5954.4.2 by Aaron Bentley
Support merging into null tree.
1242
            if parent_id is None and name is not None:
1243
                # if parent_id is None and name is non-None, current file is
1244
                # the tree root.
1245
                if names[self.winner_idx[parent_id_winner]] != '':
1246
                    raise AssertionError(
1247
                        'File looks like a root, but named %s' %
1248
                        names[self.winner_idx[parent_id_winner]])
1249
                parent_trans_id = transform.ROOT_PARENT
1250
            else:
1251
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1252
            self.tt.adjust_path(name, parent_trans_id,
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1253
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1254
6883.10.1 by Jelmer Vernooij
Fix more tets.
1255
    def _do_merge_contents(self, paths, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1256
        """Performs a merge on file_id contents."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1257
        def contents_pair(tree, path):
1258
            if path is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1259
                return (None, None)
6809.4.17 by Jelmer Vernooij
One more :)
1260
            try:
1261
                kind = tree.kind(path, file_id)
1262
            except errors.NoSuchFile:
1263
                return (None, None)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1264
            if kind == "file":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1265
                contents = tree.get_file_sha1(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1266
            elif kind == "symlink":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1267
                contents = tree.get_symlink_target(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1268
            else:
1269
                contents = None
1270
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1271
6883.10.1 by Jelmer Vernooij
Fix more tets.
1272
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1273
        # See SPOT run.  run, SPOT, run.
1274
        # So we're not QUITE repeating ourselves; we do tricky things with
1275
        # file kind...
6883.10.1 by Jelmer Vernooij
Fix more tets.
1276
        other_pair = contents_pair(self.other_tree, other_path)
1277
        this_pair = contents_pair(self.this_tree, this_path)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1278
        if self._lca_trees:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1279
            (base_path, lca_paths) = base_path
1280
            base_pair = contents_pair(self.base_tree, base_path)
1281
            lca_pairs = [contents_pair(tree, path)
1282
                         for tree, path in zip(self._lca_trees, lca_paths)]
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1283
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1284
                                         this_pair, allow_overriding_lca=False)
1285
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1286
            base_pair = contents_pair(self.base_tree, base_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1287
            if base_pair == other_pair:
1288
                winner = 'this'
1289
            else:
1290
                # We delayed evaluating this_pair as long as we can to avoid
1291
                # unnecessary sha1 calculation
6883.10.1 by Jelmer Vernooij
Fix more tets.
1292
                this_pair = contents_pair(self.this_tree, this_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1293
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1294
        if winner == 'this':
1295
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1296
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1297
        # We have a hypothetical conflict, but if we have files, then we
1298
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1299
        trans_id = self.tt.trans_id_file_id(file_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1300
        params = MergeFileHookParams(
1301
            self, file_id, (base_path, other_path,
1302
            this_path), trans_id, this_pair[0],
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1303
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1304
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1305
        hook_status = 'not_applicable'
1306
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1307
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1308
            if hook_status != 'not_applicable':
1309
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1310
                break
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1311
        # If the merge ends up replacing the content of the file, we get rid of
1312
        # it at the end of this method (this variable is used to track the
1313
        # exceptions to this rule).
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1314
        keep_this = False
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1315
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1316
        if hook_status == 'not_applicable':
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1317
            # No merge hook was able to resolve the situation. Two cases exist:
1318
            # a content conflict or a duplicate one.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1319
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1320
            name = self.tt.final_name(trans_id)
1321
            parent_id = self.tt.final_parent(trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1322
            duplicate = False
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1323
            inhibit_content_conflict = False
1324
            if params.this_kind is None: # file_id is not in THIS
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1325
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1326
                if self.this_tree.is_versioned(other_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1327
                    # Two entries for the same path
1328
                    keep_this = True
1329
                    # versioning the merged file will trigger a duplicate
1330
                    # conflict
1331
                    self.tt.version_file(file_id, trans_id)
1332
                    transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1333
                        self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1334
                        other_path, file_id=file_id,
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1335
                        filter_tree_path=self._get_filter_tree_path(file_id))
1336
                    inhibit_content_conflict = True
1337
            elif params.other_kind is None: # file_id is not in OTHER
1338
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1339
                if self.other_tree.is_versioned(this_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1340
                    # Two entries for the same path again, but here, the other
1341
                    # entry will also be merged.  We simply inhibit the
1342
                    # 'content' conflict creation because we know OTHER will
1343
                    # create (or has already created depending on ordering) an
1344
                    # entry at the same path. This will trigger a 'duplicate'
1345
                    # conflict later.
1346
                    keep_this = True
1347
                    inhibit_content_conflict = True
1348
            if not inhibit_content_conflict:
1349
                if params.this_kind is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1350
                    self.tt.unversion_file(trans_id)
1351
                # This is a contents conflict, because none of the available
1352
                # functions could merge it.
6923.1.1 by Jelmer Vernooij
Fix regression.
1353
                file_group = self._dump_conflicts(
1354
                        name, (base_path, other_path, this_path), parent_id,
1355
                        file_id, set_version=True)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1356
                self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1357
        elif hook_status == 'success':
1358
            self.tt.create_file(lines, trans_id)
1359
        elif hook_status == 'conflicted':
1360
            # XXX: perhaps the hook should be able to provide
1361
            # the BASE/THIS/OTHER files?
1362
            self.tt.create_file(lines, trans_id)
1363
            self._raw_conflicts.append(('text conflict', trans_id))
1364
            name = self.tt.final_name(trans_id)
1365
            parent_id = self.tt.final_parent(trans_id)
6923.1.1 by Jelmer Vernooij
Fix regression.
1366
            self._dump_conflicts(
1367
                name, (base_path, other_path, this_path), parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1368
        elif hook_status == 'delete':
1369
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1370
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1371
        elif hook_status == 'done':
1372
            # The hook function did whatever it needs to do directly, no
1373
            # further action needed here.
1374
            pass
1375
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1376
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1377
        if not this_path and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1378
            self.tt.version_file(file_id, trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1379
        if not keep_this:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1380
            # The merge has been performed and produced a new content, so the
1381
            # old contents should not be retained.
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1382
            self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1383
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1384
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1385
    def _default_other_winner_merge(self, merge_hook_params):
1386
        """Replace this contents with other."""
1387
        file_id = merge_hook_params.file_id
1388
        trans_id = merge_hook_params.trans_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
1389
        if merge_hook_params.other_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1390
            # OTHER changed the file
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1391
            transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1392
                self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1393
                merge_hook_params.other_path, file_id=file_id,
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1394
                filter_tree_path=self._get_filter_tree_path(file_id))
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1395
            return 'done', None
6883.10.1 by Jelmer Vernooij
Fix more tets.
1396
        elif merge_hook_params.this_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1397
            # OTHER deleted the file
1398
            return 'delete', None
1399
        else:
1400
            raise AssertionError(
1401
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1402
                % (file_id,))
1403
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1404
    def merge_contents(self, merge_hook_params):
1405
        """Fallback merge logic after user installed hooks."""
1406
        # This function is used in merge hooks as the fallback instance.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1407
        # Perhaps making this function and the functions it calls be a
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1408
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1409
        if merge_hook_params.winner == 'other':
1410
            # OTHER is a straight winner, so replace this contents with other
1411
            return self._default_other_winner_merge(merge_hook_params)
1412
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1413
            # THIS and OTHER are both files, so text merge.  Either
1414
            # BASE is a file, or both converted to files, so at least we
1415
            # have agreement that output should be a file.
1416
            try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1417
                self.text_merge(merge_hook_params.trans_id,
1418
                                merge_hook_params.paths, merge_hook_params.file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1419
            except errors.BinaryFile:
1420
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1421
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1422
        else:
1423
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1424
6883.10.1 by Jelmer Vernooij
Fix more tets.
1425
    def get_lines(self, tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1426
        """Return the lines in a file, or an empty list."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1427
        if path is None:
1428
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1429
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1430
            kind = tree.kind(path, file_id)
1431
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1432
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1433
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1434
            if kind != 'file':
1435
                return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1436
            return tree.get_file_lines(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1437
6883.10.1 by Jelmer Vernooij
Fix more tets.
1438
    def text_merge(self, trans_id, paths, file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1439
        """Perform a three-way text merge on a file_id"""
1440
        # it's possible that we got here with base as a different type.
1441
        # if so, we just want two-way text conflicts.
6883.10.1 by Jelmer Vernooij
Fix more tets.
1442
        base_path, other_path, this_path = paths
1443
        base_lines = self.get_lines(self.base_tree, base_path, file_id)
1444
        other_lines = self.get_lines(self.other_tree, other_path, file_id)
1445
        this_lines = self.get_lines(self.this_tree, this_path, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1446
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1447
                           is_cherrypick=self.cherrypick)
6973.9.1 by Jelmer Vernooij
More test fixes.
1448
        start_marker = b"!START OF MERGE CONFLICT!" + b"I HOPE THIS IS UNIQUE"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1449
        if self.show_base is True:
7045.1.1 by Jelmer Vernooij
Fix another 300 tests.
1450
            base_marker = b'|' * 7
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1451
        else:
1452
            base_marker = None
1453
1454
        def iter_merge3(retval):
1455
            retval["text_conflicts"] = False
6973.9.1 by Jelmer Vernooij
More test fixes.
1456
            for line in m3.merge_lines(name_a = b"TREE",
1457
                                       name_b = b"MERGE-SOURCE",
1458
                                       name_base = b"BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1459
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1460
                                       base_marker=base_marker,
1461
                                       reprocess=self.reprocess):
1462
                if line.startswith(start_marker):
1463
                    retval["text_conflicts"] = True
6973.9.1 by Jelmer Vernooij
More test fixes.
1464
                    yield line.replace(start_marker, b'<' * 7)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1465
                else:
1466
                    yield line
1467
        retval = {}
1468
        merge3_iterator = iter_merge3(retval)
1469
        self.tt.create_file(merge3_iterator, trans_id)
1470
        if retval["text_conflicts"] is True:
1471
            self._raw_conflicts.append(('text conflict', trans_id))
1472
            name = self.tt.final_name(trans_id)
1473
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1474
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1475
                                              this_lines, base_lines,
1476
                                              other_lines)
1477
            file_group.append(trans_id)
1478
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1479
    def _get_filter_tree_path(self, file_id):
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1480
        if self.this_tree.supports_content_filtering():
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1481
            # We get the path from the working tree if it exists.
1482
            # That fails though when OTHER is adding a file, so
1483
            # we fall back to the other tree to find the path if
1484
            # it doesn't exist locally.
1485
            try:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1486
                return self.this_tree.id2path(file_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1487
            except errors.NoSuchId:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1488
                return self.other_tree.id2path(file_id)
1489
        # Skip the id2path lookup for older formats
1490
        return None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1491
6883.10.1 by Jelmer Vernooij
Fix more tets.
1492
    def _dump_conflicts(self, name, paths, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1493
                        base_lines=None, other_lines=None, set_version=False,
1494
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1495
        """Emit conflict files.
1496
        If this_lines, base_lines, or other_lines are omitted, they will be
1497
        determined automatically.  If set_version is true, the .OTHER, .THIS
1498
        or .BASE (in that order) will be created as versioned files.
1499
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1500
        base_path, other_path, this_path = paths
1501
        data = [('OTHER', self.other_tree, other_path, other_lines),
1502
                ('THIS', self.this_tree, this_path, this_lines)]
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1503
        if not no_base:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1504
            data.append(('BASE', self.base_tree, base_path, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1505
1506
        # We need to use the actual path in the working tree of the file here,
1507
        # ignoring the conflict suffixes
1508
        wt = self.this_tree
1509
        if wt.supports_content_filtering():
1510
            try:
1511
                filter_tree_path = wt.id2path(file_id)
1512
            except errors.NoSuchId:
1513
                # file has been deleted
1514
                filter_tree_path = None
1515
        else:
1516
            # Skip the id2path lookup for older formats
1517
            filter_tree_path = None
1518
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1519
        versioned = False
1520
        file_group = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
1521
        for suffix, tree, path, lines in data:
1522
            if path is not None:
6809.4.21 by Jelmer Vernooij
Fix long lines.
1523
                trans_id = self._conflict_file(
1524
                        name, parent_id, path, tree, file_id, suffix, lines,
1525
                        filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1526
                file_group.append(trans_id)
1527
                if set_version and not versioned:
1528
                    self.tt.version_file(file_id, trans_id)
1529
                    versioned = True
1530
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1531
6809.4.21 by Jelmer Vernooij
Fix long lines.
1532
    def _conflict_file(self, name, parent_id, path, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1533
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1534
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1535
        name = name + '.' + suffix
1536
        trans_id = self.tt.create_path(name, parent_id)
6809.4.21 by Jelmer Vernooij
Fix long lines.
1537
        transform.create_from_tree(
1538
                self.tt, trans_id, tree, path,
6977.2.1 by Jelmer Vernooij
Require that get_file implementations are contect managers, simplify file handling in transform.
1539
                file_id=file_id, chunks=lines,
6809.4.21 by Jelmer Vernooij
Fix long lines.
1540
                filter_tree_path=filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1541
        return trans_id
1542
6883.10.1 by Jelmer Vernooij
Fix more tets.
1543
    def merge_executable(self, paths, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1544
        """Perform a merge on the execute bit."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1545
        executable = [self.executable(t, p, file_id) for t, p in zip([self.base_tree,
1546
                      self.other_tree, self.this_tree], paths)]
1547
        self._merge_executable(paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1548
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1549
6883.10.1 by Jelmer Vernooij
Fix more tets.
1550
    def _merge_executable(self, paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1551
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1552
        """Perform a merge on the execute bit."""
1553
        base_executable, other_executable, this_executable = executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1554
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1555
        if file_status == "deleted":
1556
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1557
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1558
        if winner == "conflict":
1559
        # There must be a None in here, if we have a conflict, but we
1560
        # need executability since file status was not deleted.
6928.1.2 by Jelmer Vernooij
Fix path specification.
1561
            if other_path is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1562
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1563
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1564
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1565
        if winner == 'this' and file_status != "modified":
1566
            return
1567
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1568
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1569
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1570
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1571
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1572
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1573
            if other_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1574
                executability = other_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1575
            elif this_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1576
                executability = this_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1577
            elif base_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1578
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1579
        if executability is not None:
1580
            trans_id = self.tt.trans_id_file_id(file_id)
1581
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1582
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1583
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1584
        """Convert all conflicts into a form that doesn't depend on trans_id"""
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1585
        content_conflict_file_ids = set()
1586
        cooked_conflicts = transform.cook_conflicts(fs_conflicts, self.tt)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1587
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1588
        for conflict in self._raw_conflicts:
1589
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1590
            if conflict_type == 'path conflict':
1591
                (trans_id, file_id,
1592
                this_parent, this_name,
1593
                other_parent, other_name) = conflict[1:]
1594
                if this_parent is None or this_name is None:
1595
                    this_path = '<deleted>'
1596
                else:
1597
                    parent_path =  fp.get_path(
1598
                        self.tt.trans_id_file_id(this_parent))
1599
                    this_path = osutils.pathjoin(parent_path, this_name)
1600
                if other_parent is None or other_name is None:
1601
                    other_path = '<deleted>'
1602
                else:
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1603
                    if other_parent == self.other_tree.get_root_id():
5050.73.9 by Vincent Ladeuil
Fix typo.
1604
                        # The tree transform doesn't know about the other root,
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1605
                        # so we special case here to avoid a NoFinalPath
1606
                        # exception
1607
                        parent_path = ''
1608
                    else:
1609
                        parent_path =  fp.get_path(
1610
                            self.tt.trans_id_file_id(other_parent))
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1611
                    other_path = osutils.pathjoin(parent_path, other_name)
1612
                c = _mod_conflicts.Conflict.factory(
1613
                    'path conflict', path=this_path,
1614
                    conflict_path=other_path,
1615
                    file_id=file_id)
1616
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1617
                for trans_id in conflict[1]:
1618
                    file_id = self.tt.final_file_id(trans_id)
1619
                    if file_id is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1620
                        # Ok we found the relevant file-id
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1621
                        break
1622
                path = fp.get_path(trans_id)
1623
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1624
                    if path.endswith(suffix):
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1625
                        # Here is the raw path
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1626
                        path = path[:-len(suffix)]
1627
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1628
                c = _mod_conflicts.Conflict.factory(conflict_type,
1629
                                                    path=path, file_id=file_id)
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1630
                content_conflict_file_ids.add(file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1631
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1632
                trans_id = conflict[1]
1633
                path = fp.get_path(trans_id)
1634
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1635
                c = _mod_conflicts.Conflict.factory(conflict_type,
1636
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1637
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1638
                raise AssertionError('bad conflict type: %r' % (conflict,))
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1639
            cooked_conflicts.append(c)
5988.2.2 by Vincent Ladeuil
Make it clear that we start from an empty cooked_conflicts list.
1640
1641
        self.cooked_conflicts = []
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1642
        # We want to get rid of path conflicts when a corresponding contents
1643
        # conflict exists. This can occur when one branch deletes a file while
1644
        # the other renames *and* modifies it. In this case, the content
1645
        # conflict is enough.
1646
        for c in cooked_conflicts:
1647
            if (c.typestring == 'path conflict'
1648
                and c.file_id in content_conflict_file_ids):
1649
                continue
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1650
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1651
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1652
1653
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1654
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1655
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1656
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1657
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1658
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1659
    history_based = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1660
    requires_file_merge_plan = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1661
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1662
    def _generate_merge_plan(self, file_id, base):
1663
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1664
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1665
1666
    def _merged_lines(self, file_id):
1667
        """Generate the merged lines.
1668
        There is no distinction between lines that are meant to contain <<<<<<<
1669
        and conflicts.
1670
        """
1671
        if self.cherrypick:
1672
            base = self.base_tree
1673
        else:
1674
            base = None
1675
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1676
        if 'merge' in debug.debug_flags:
1677
            plan = list(plan)
1678
            trans_id = self.tt.trans_id_file_id(file_id)
1679
            name = self.tt.final_name(trans_id) + '.plan'
7029.4.1 by Jelmer Vernooij
Fix a bunch of merge tests.
1680
            contents = (b'%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1681
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
7029.4.1 by Jelmer Vernooij
Fix a bunch of merge tests.
1682
        textmerge = versionedfile.PlanWeaveMerge(plan, b'<<<<<<< TREE\n',
1683
                                                 b'>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1684
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1685
        if conflicts:
1686
            base_lines = textmerge.base_from_plan()
1687
        else:
1688
            base_lines = None
1689
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1690
6883.10.1 by Jelmer Vernooij
Fix more tets.
1691
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1692
        """Perform a (weave) text merge for a given file and file-id.
1693
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1694
        and a conflict will be noted.
1695
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1696
        base_path, other_path, this_path = paths
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1697
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1698
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1699
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1700
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1701
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1702
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1703
        if base_lines is not None:
1704
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1705
            self._raw_conflicts.append(('text conflict', trans_id))
1706
            name = self.tt.final_name(trans_id)
1707
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1708
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1709
                                              no_base=False,
1710
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1711
            file_group.append(trans_id)
1712
1713
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1714
class LCAMerger(WeaveMerger):
1715
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1716
    requires_file_merge_plan = True
1717
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1718
    def _generate_merge_plan(self, file_id, base):
1719
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1720
                                                  base=base)
1721
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1722
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1723
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1724
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1725
    requires_file_merge_plan = False
1726
6883.10.1 by Jelmer Vernooij
Fix more tets.
1727
    def dump_file(self, temp_dir, name, tree, path, file_id=None):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1728
        out_path = osutils.pathjoin(temp_dir, name)
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1729
        with open(out_path, "wb") as out_file:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1730
            in_file = tree.get_file(path, file_id=None)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1731
            for line in in_file:
1732
                out_file.write(line)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1733
        return out_path
1734
6883.10.1 by Jelmer Vernooij
Fix more tets.
1735
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1736
        """Perform a diff3 merge using a specified file-id and trans-id.
1737
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1738
        will be dumped, and a will be conflict noted.
1739
        """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1740
        import breezy.patch
6883.10.1 by Jelmer Vernooij
Fix more tets.
1741
        base_path, other_path, this_path = paths
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1742
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1743
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1744
            new_file = osutils.pathjoin(temp_dir, "new")
6883.10.1 by Jelmer Vernooij
Fix more tets.
1745
            this = self.dump_file(temp_dir, "this", self.this_tree, this_path, file_id)
1746
            base = self.dump_file(temp_dir, "base", self.base_tree, base_path, file_id)
1747
            other = self.dump_file(temp_dir, "other", self.other_tree, other_path, file_id)
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1748
            status = breezy.patch.diff3(new_file, this, base, other)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1749
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1750
                raise errors.BzrError("Unhandled diff3 exit code")
6861.2.1 by Jelmer Vernooij
vf Move file planning to breezy.bzr.inventorytree.
1751
            with open(new_file, 'rb') as f:
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1752
                self.tt.create_file(f, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1753
            if status == 1:
1754
                name = self.tt.final_name(trans_id)
1755
                parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1756
                self._dump_conflicts(name, paths, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1757
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1758
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1759
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1760
1761
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1762
class PathNotInTree(errors.BzrError):
1763
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1764
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1765
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1766
    def __init__(self, path, tree):
1767
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1768
1769
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1770
class MergeIntoMerger(Merger):
1771
    """Merger that understands other_tree will be merged into a subdir.
1772
1773
    This also changes the Merger api so that it uses real Branch, revision_id,
1774
    and RevisonTree objects, rather than using revision specs.
1775
    """
1776
1777
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
5246.2.22 by Andrew Bennetts
Minor tweaks.
1778
            source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1779
        """Create a new MergeIntoMerger object.
1780
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1781
        source_subpath in other_tree will be effectively copied to
1782
        target_subdir in this_tree.
1783
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1784
        :param this_tree: The tree that we will be merging into.
1785
        :param other_branch: The Branch we will be merging from.
1786
        :param other_tree: The RevisionTree object we want to merge.
1787
        :param target_subdir: The relative path where we want to merge
1788
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1789
        :param source_subpath: The relative path specifying the subtree of
1790
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1791
        """
1792
        # It is assumed that we are merging a tree that is not in our current
1793
        # ancestry, which means we are using the "EmptyTree" as our basis.
1794
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
1795
                                _mod_revision.NULL_REVISION)
1796
        super(MergeIntoMerger, self).__init__(
1797
            this_branch=this_tree.branch,
1798
            this_tree=this_tree,
1799
            other_tree=other_tree,
1800
            base_tree=null_ancestor_tree,
1801
            )
1802
        self._target_subdir = target_subdir
1803
        self._source_subpath = source_subpath
1804
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1805
        if other_rev_id is None:
1806
            other_rev_id = other_tree.get_revision_id()
1807
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1808
        self.base_is_ancestor = True
1809
        self.backup_files = True
1810
        self.merge_type = Merge3Merger
1811
        self.show_base = False
1812
        self.reprocess = False
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1813
        self.interesting_files = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1814
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
1815
              target_subdir=self._target_subdir,
1816
              source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1817
        if self._source_subpath != '':
1818
            # If this isn't a partial merge make sure the revisions will be
1819
            # present.
1820
            self._maybe_fetch(self.other_branch, self.this_branch,
1821
                self.other_basis)
1822
1823
    def set_pending(self):
1824
        if self._source_subpath != '':
1825
            return
1826
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1827
1828
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1829
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1830
    """Wrap a merge-type class to provide extra parameters.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1831
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1832
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1833
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1834
    the 'merge_type' member.  It is difficult override do_merge without
1835
    re-writing the whole thing, so instead we create a wrapper which will pass
1836
    the extra parameters.
1837
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1838
1839
    def __init__(self, merge_type, **kwargs):
1840
        self._extra_kwargs = kwargs
1841
        self._merge_type = merge_type
1842
1843
    def __call__(self, *args, **kwargs):
1844
        kwargs.update(self._extra_kwargs)
1845
        return self._merge_type(*args, **kwargs)
1846
1847
    def __getattr__(self, name):
1848
        return getattr(self._merge_type, name)
1849
1850
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1851
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1852
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1853
1854
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1855
        """Initialize the merger object.
1856
1857
        :param args: See Merge3Merger.__init__'s args.
1858
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1859
            source_subpath and target_subdir.
1860
        :keyword source_subpath: The relative path specifying the subtree of
1861
            other_tree to merge into this_tree.
1862
        :keyword target_subdir: The relative path where we want to merge
1863
            other_tree into this_tree
1864
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1865
        # All of the interesting work happens during Merge3Merger.__init__(),
1866
        # so we have have to hack in to get our extra parameters set.
1867
        self._source_subpath = kwargs.pop('source_subpath')
1868
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1869
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1870
1871
    def _compute_transform(self):
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
1872
        with ui.ui_factory.nested_progress_bar() as child_pb:
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1873
            entries = self._entries_to_incorporate()
1874
            entries = list(entries)
6874.2.9 by Jelmer Vernooij
Fix test.
1875
            for num, (entry, parent_id, relpath) in enumerate(entries):
6138.4.1 by Jonathan Riddell
add gettext to progress bar strings
1876
                child_pb.update(gettext('Preparing file merge'), num, len(entries))
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1877
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
6874.2.9 by Jelmer Vernooij
Fix test.
1878
                path = osutils.pathjoin(self._source_subpath, relpath)
6874.2.8 by Jelmer Vernooij
Fix test.
1879
                trans_id = transform.new_by_entry(path, self.tt, entry,
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1880
                    parent_trans_id, self.other_tree)
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1881
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1882
1883
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1884
        """Yields pairs of (inventory_entry, new_parent)."""
6405.2.10 by Jelmer Vernooij
Fix more tests.
1885
        other_inv = self.other_tree.root_inventory
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1886
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1887
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1888
            # XXX: The error would be clearer if it gave the URL of the source
1889
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1890
            raise PathNotInTree(self._source_subpath, "Source tree")
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
1891
        subdir = other_inv.get_entry(subdir_id)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1892
        parent_in_target = osutils.dirname(self._target_subdir)
6405.2.10 by Jelmer Vernooij
Fix more tests.
1893
        target_id = self.this_tree.path2id(parent_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1894
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1895
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1896
        name_in_target = osutils.basename(self._target_subdir)
1897
        merge_into_root = subdir.copy()
1898
        merge_into_root.name = name_in_target
6405.2.10 by Jelmer Vernooij
Fix more tests.
1899
        if self.this_tree.has_id(merge_into_root.file_id):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1900
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1901
            # This can happen fairly easily if the directory we are
1902
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1903
            # their root_id.  Users will expect this to Just Work, so we
1904
            # change the file-id here.
1905
            # Non-root file-ids could potentially conflict too.  That's really
1906
            # an edge case, so we don't do anything special for those.  We let
1907
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1908
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1909
        yield (merge_into_root, target_id, '')
5246.2.10 by Andrew Bennetts
Add more tests.
1910
        if subdir.kind != 'directory':
1911
            # No children, so we are done.
1912
            return
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1913
        for path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1914
            parent_id = entry.parent_id
1915
            if parent_id == subdir.file_id:
1916
                # The root's parent ID has changed, so make sure children of
1917
                # the root refer to the new ID.
1918
                parent_id = merge_into_root.file_id
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1919
            yield (entry, parent_id, path)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1920
1921
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1922
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1923
                backup_files=False,
1924
                merge_type=Merge3Merger,
1925
                show_base=False,
1926
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1927
                other_rev_id=None,
1928
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1929
                this_tree=None,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
1930
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1931
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1932
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1933
    Typical use is probably::
1934
1935
        merge_inner(branch, branch.get_revision_tree(other_revision),
1936
                    branch.get_revision_tree(base_revision))
1937
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1938
    if this_tree is None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1939
        raise errors.BzrError("breezy.merge.merge_inner requires a this_tree "
5993.2.1 by Jelmer Vernooij
Add test for rootless tree merge.
1940
                              "parameter")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1941
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
6719.1.2 by Jelmer Vernooij
Fix some tests.
1942
                    change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1943
    merger.backup_files = backup_files
1944
    merger.merge_type = merge_type
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1945
    merger.ignore_zero = ignore_zero
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1946
    merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1947
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1948
    merger.reprocess = reprocess
1949
    merger.other_rev_id = other_rev_id
1950
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1951
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1952
    if get_revision_id is None:
1953
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1954
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1955
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1956
    return merger.do_merge()
1957
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1958
1959
merge_type_registry = registry.Registry()
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1960
merge_type_registry.register('diff3', Diff3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1961
                             "Merge using external diff3.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1962
merge_type_registry.register('lca', LCAMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1963
                             "LCA-newness merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1964
merge_type_registry.register('merge3', Merge3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1965
                             "Native diff3-style merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1966
merge_type_registry.register('weave', WeaveMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1967
                             "Weave-based merge.")
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1968
1969
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1970
def get_merge_type_registry():
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1971
    """Merge type registry was previously in breezy.option
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1972
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1973
    This method provides a backwards compatible way to retrieve it.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1974
    """
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1975
    return merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1976
1977
1978
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1979
    def status_a(revision, text):
1980
        if revision in ancestors_b:
1981
            return 'killed-b', text
1982
        else:
1983
            return 'new-a', text
1984
1985
    def status_b(revision, text):
1986
        if revision in ancestors_a:
1987
            return 'killed-a', text
1988
        else:
1989
            return 'new-b', text
1990
1991
    plain_a = [t for (a, t) in annotated_a]
1992
    plain_b = [t for (a, t) in annotated_b]
1993
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1994
    blocks = matcher.get_matching_blocks()
1995
    a_cur = 0
1996
    b_cur = 0
1997
    for ai, bi, l in blocks:
1998
        # process all mismatched sections
1999
        # (last mismatched section is handled because blocks always
2000
        # includes a 0-length last block)
2001
        for revision, text in annotated_a[a_cur:ai]:
2002
            yield status_a(revision, text)
2003
        for revision, text in annotated_b[b_cur:bi]:
2004
            yield status_b(revision, text)
2005
        # and now the matched section
2006
        a_cur = ai + l
2007
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
2008
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
2009
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2010
2011
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2012
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2013
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2014
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2015
        """Contructor.
2016
2017
        :param a_rev: Revision-id of one revision to merge
2018
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2019
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2020
        :param key_prefix: A prefix for accessing keys in vf, typically
2021
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2022
        """
2023
        self.a_rev = a_rev
2024
        self.b_rev = b_rev
2025
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2026
        self._last_lines = None
2027
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2028
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2029
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2030
        self._precache_tip_lines()
2031
2032
    def _precache_tip_lines(self):
2033
        lines = self.get_lines([self.a_rev, self.b_rev])
2034
        self.lines_a = lines[self.a_rev]
2035
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2036
2037
    def get_lines(self, revisions):
2038
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2039
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2040
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2041
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2042
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2043
        result = {}
2044
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2045
            if record.storage_kind == 'absent':
2046
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2047
            result[record.key[-1]] = osutils.chunks_to_lines(
2048
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2049
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2050
2051
    def plan_merge(self):
2052
        """Generate a 'plan' for merging the two revisions.
2053
2054
        This involves comparing their texts and determining the cause of
2055
        differences.  If text A has a line and text B does not, then either the
2056
        line was added to text A, or it was deleted from B.  Once the causes
2057
        are combined, they are written out in the format described in
2058
        VersionedFile.plan_merge
2059
        """
2060
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2061
        unique_a, unique_b = self._unique_lines(blocks)
2062
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2063
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2064
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2065
2066
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2067
        last_i = 0
2068
        last_j = 0
2069
        for i, j, n in blocks:
2070
            for a_index in range(last_i, i):
2071
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2072
                    if a_index in killed_b:
2073
                        yield 'conflicted-a', self.lines_a[a_index]
2074
                    else:
2075
                        yield 'new-a', self.lines_a[a_index]
2076
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2077
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2078
            for b_index in range(last_j, j):
2079
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2080
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2081
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2082
                    else:
2083
                        yield 'new-b', self.lines_b[b_index]
2084
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2085
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2086
            # handle common lines
2087
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2088
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2089
            last_i = i+n
2090
            last_j = j+n
2091
2092
    def _get_matching_blocks(self, left_revision, right_revision):
2093
        """Return a description of which sections of two revisions match.
2094
2095
        See SequenceMatcher.get_matching_blocks
2096
        """
3144.3.7 by Aaron Bentley
Update from review
2097
        cached = self._cached_matching_blocks.get((left_revision,
2098
                                                   right_revision))
2099
        if cached is not None:
2100
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2101
        if self._last_lines_revision_id == left_revision:
2102
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2103
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2104
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2105
            lines = self.get_lines([left_revision, right_revision])
2106
            left_lines = lines[left_revision]
2107
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2108
        self._last_lines = right_lines
2109
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2110
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2111
                                                       right_lines)
2112
        return matcher.get_matching_blocks()
2113
2114
    def _unique_lines(self, matching_blocks):
2115
        """Analyse matching_blocks to determine which lines are unique
2116
2117
        :return: a tuple of (unique_left, unique_right), where the values are
2118
            sets of line numbers of unique lines.
2119
        """
2120
        last_i = 0
2121
        last_j = 0
2122
        unique_left = []
2123
        unique_right = []
2124
        for i, j, n in matching_blocks:
2125
            unique_left.extend(range(last_i, i))
2126
            unique_right.extend(range(last_j, j))
2127
            last_i = i + n
2128
            last_j = j + n
2129
        return unique_left, unique_right
2130
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2131
    @staticmethod
2132
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2133
        """Remove changes from new_plan that came from old_plan.
2134
2135
        It is assumed that the difference between the old_plan and new_plan
2136
        is their choice of 'b' text.
2137
2138
        All lines from new_plan that differ from old_plan are emitted
2139
        verbatim.  All lines from new_plan that match old_plan but are
2140
        not about the 'b' revision are emitted verbatim.
2141
2142
        Lines that match and are about the 'b' revision are the lines we
2143
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2144
        is skipped entirely.
2145
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2146
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2147
                                                       new_plan)
2148
        last_j = 0
2149
        for i, j, n in matcher.get_matching_blocks():
2150
            for jj in range(last_j, j):
2151
                yield new_plan[jj]
2152
            for jj in range(j, j+n):
2153
                plan_line = new_plan[jj]
2154
                if plan_line[0] == 'new-b':
2155
                    pass
2156
                elif plan_line[0] == 'killed-b':
2157
                    yield 'unchanged', plan_line[1]
2158
                else:
2159
                    yield plan_line
2160
            last_j = j + n
2161
2162
2163
class _PlanMerge(_PlanMergeBase):
2164
    """Plan an annotate merge using on-the-fly annotation"""
2165
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2166
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2167
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2168
        self.a_key = self._key_prefix + (self.a_rev,)
2169
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2170
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2171
        heads = self.graph.heads((self.a_key, self.b_key))
2172
        if len(heads) == 1:
2173
            # one side dominates, so we can just return its values, yay for
2174
            # per-file graphs
2175
            # Ideally we would know that before we get this far
2176
            self._head_key = heads.pop()
2177
            if self._head_key == self.a_key:
2178
                other = b_rev
2179
            else:
2180
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2181
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2182
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2183
            self._weave = None
2184
        else:
2185
            self._head_key = None
2186
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2187
2188
    def _precache_tip_lines(self):
2189
        # Turn this into a no-op, because we will do this later
2190
        pass
2191
2192
    def _find_recursive_lcas(self):
2193
        """Find all the ancestors back to a unique lca"""
2194
        cur_ancestors = (self.a_key, self.b_key)
2195
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2196
        # rather than a key tuple. We will just map that directly to no common
2197
        # ancestors.
2198
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2199
        while True:
2200
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2201
            # Map a plain NULL_REVISION to a simple no-ancestors
6619.3.12 by Jelmer Vernooij
Use 2to3 set_literal fixer.
2202
            if next_lcas == {_mod_revision.NULL_REVISION}:
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2203
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2204
            # Order the lca's based on when they were merged into the tip
2205
            # While the actual merge portion of weave merge uses a set() of
2206
            # active revisions, the order of insertion *does* effect the
2207
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2208
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2209
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2210
                                                                    next_lcas))
2211
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2212
            if len(next_lcas) == 0:
2213
                break
2214
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2215
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2216
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2217
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2218
                # More than 2 lca's, fall back to grabbing all nodes between
2219
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2220
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2221
                             ' %s, %s\n=> %s',
2222
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2223
                cur_lcas = next_lcas
2224
                while len(cur_lcas) > 1:
2225
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2226
                if len(cur_lcas) == 0:
2227
                    # No common base to find, use the full ancestry
2228
                    unique_lca = None
2229
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2230
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2231
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2232
                        # find_lca will return a plain 'NULL_REVISION' rather
2233
                        # than a key tuple when there is no common ancestor, we
2234
                        # prefer to just use None, because it doesn't confuse
2235
                        # _get_interesting_texts()
2236
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2237
                parent_map.update(self._find_unique_parents(next_lcas,
2238
                                                            unique_lca))
2239
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2240
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2241
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2242
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2243
    def _find_unique_parents(self, tip_keys, base_key):
2244
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2245
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2246
        :param tip_keys: Nodes that are interesting
2247
        :param base_key: Cull all ancestors of this node
2248
        :return: The parent map for all revisions between tip_keys and
2249
            base_key. base_key will be included. References to nodes outside of
2250
            the ancestor set will also be removed.
2251
        """
2252
        # TODO: this would be simpler if find_unique_ancestors took a list
2253
        #       instead of a single tip, internally it supports it, but it
2254
        #       isn't a "backwards compatible" api change.
2255
        if base_key is None:
2256
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2257
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2258
            # thus confuses things like _get_interesting_texts, and our logic
2259
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2260
            if _mod_revision.NULL_REVISION in parent_map:
2261
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2262
        else:
2263
            interesting = set()
2264
            for tip in tip_keys:
2265
                interesting.update(
2266
                    self.graph.find_unique_ancestors(tip, [base_key]))
2267
            parent_map = self.graph.get_parent_map(interesting)
2268
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2269
        culled_parent_map, child_map, tails = self._remove_external_references(
2270
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2271
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2272
        if base_key is not None:
2273
            tails.remove(base_key)
2274
            self._prune_tails(culled_parent_map, child_map, tails)
2275
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2276
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2277
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2278
2279
    @staticmethod
2280
    def _remove_external_references(parent_map):
2281
        """Remove references that go outside of the parent map.
2282
2283
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2284
        :return: (filtered_parent_map, child_map, tails)
2285
            filtered_parent_map is parent_map without external references
2286
            child_map is the {parent_key: [child_keys]} mapping
2287
            tails is a list of nodes that do not have any parents in the map
2288
        """
2289
        # TODO: The basic effect of this function seems more generic than
2290
        #       _PlanMerge. But the specific details of building a child_map,
2291
        #       and computing tails seems very specific to _PlanMerge.
2292
        #       Still, should this be in Graph land?
2293
        filtered_parent_map = {}
2294
        child_map = {}
2295
        tails = []
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
2296
        for key, parent_keys in viewitems(parent_map):
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2297
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2298
            if not culled_parent_keys:
2299
                tails.append(key)
2300
            for parent_key in culled_parent_keys:
2301
                child_map.setdefault(parent_key, []).append(key)
2302
            # TODO: Do we want to do this, it adds overhead for every node,
2303
            #       just to say that the node has no children
2304
            child_map.setdefault(key, [])
2305
            filtered_parent_map[key] = culled_parent_keys
2306
        return filtered_parent_map, child_map, tails
2307
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2308
    @staticmethod
2309
    def _prune_tails(parent_map, child_map, tails_to_remove):
2310
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2311
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2312
        This will remove the supplied revisions until no more children have 0
2313
        parents.
2314
2315
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2316
            be modified in place.
2317
        :param tails_to_remove: A list of tips that should be removed,
2318
            this list will be consumed
2319
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2320
            this dict will be modified
2321
        :return: None, parent_map will be modified in place.
2322
        """
2323
        while tails_to_remove:
2324
            next = tails_to_remove.pop()
2325
            parent_map.pop(next)
2326
            children = child_map.pop(next)
2327
            for child in children:
2328
                child_parents = parent_map[child]
2329
                child_parents.remove(next)
2330
                if len(child_parents) == 0:
2331
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2332
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2333
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2334
        """Return a dict of texts we are interested in.
2335
2336
        Note that the input is in key tuples, but the output is in plain
2337
        revision ids.
2338
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2339
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2340
        :return: A dict of {'revision_id':lines} as returned by
2341
            _PlanMergeBase.get_lines()
2342
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2343
        all_revision_keys = set(parent_map)
2344
        all_revision_keys.add(self.a_key)
2345
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2346
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2347
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2348
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2349
        return all_texts
2350
2351
    def _build_weave(self):
6670.4.3 by Jelmer Vernooij
Fix more imports.
2352
        from .bzr import weave
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2353
        self._weave = weave.Weave(weave_name='in_memory_weave',
2354
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2355
        parent_map = self._find_recursive_lcas()
2356
2357
        all_texts = self._get_interesting_texts(parent_map)
2358
2359
        # Note: Unfortunately, the order given by topo_sort will effect the
2360
        # ordering resolution in the output. Specifically, if you add A then B,
2361
        # then in the output text A lines will show up before B lines. And, of
2362
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2363
        # So we use merge_sort, and add a fake node on the tip.
2364
        # This ensures that left-hand parents will always be inserted into the
2365
        # weave before right-hand parents.
2366
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2367
        parent_map[tip_key] = (self.a_key, self.b_key)
2368
2369
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2370
                                                                  tip_key)):
2371
            if key == tip_key:
2372
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2373
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2374
            parent_keys = parent_map[key]
2375
            revision_id = key[-1]
2376
            parent_ids = [k[-1] for k in parent_keys]
2377
            self._weave.add_lines(revision_id, parent_ids,
2378
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2379
2380
    def plan_merge(self):
2381
        """Generate a 'plan' for merging the two revisions.
2382
2383
        This involves comparing their texts and determining the cause of
2384
        differences.  If text A has a line and text B does not, then either the
2385
        line was added to text A, or it was deleted from B.  Once the causes
2386
        are combined, they are written out in the format described in
2387
        VersionedFile.plan_merge
2388
        """
2389
        if self._head_key is not None: # There was a single head
2390
            if self._head_key == self.a_key:
2391
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2392
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2393
                if self._head_key != self.b_key:
2394
                    raise AssertionError('There was an invalid head: %s != %s'
2395
                                         % (self.b_key, self._head_key))
2396
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2397
            head_rev = self._head_key[-1]
2398
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2399
            return ((plan, line) for line in lines)
2400
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2401
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2402
2403
class _PlanLCAMerge(_PlanMergeBase):
2404
    """
3144.3.7 by Aaron Bentley
Update from review
2405
    This merge algorithm differs from _PlanMerge in that:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2406
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2407
    1. comparisons are done against LCAs only
2408
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2409
       another are marked as conflicts, by emitting the line as conflicted-a
2410
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2411
2412
    This is faster, and hopefully produces more useful output.
2413
    """
2414
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2415
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2416
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2417
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2418
        self.lcas = set()
2419
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2420
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2421
                self.lcas.add(lca)
2422
            else:
2423
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2424
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2425
            if _mod_revision.is_null(lca):
2426
                lca_lines = []
2427
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2428
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2429
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2430
                                                           lca_lines)
2431
            blocks = list(matcher.get_matching_blocks())
2432
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2433
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2434
                                                           lca_lines)
2435
            blocks = list(matcher.get_matching_blocks())
2436
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2437
3144.3.7 by Aaron Bentley
Update from review
2438
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2439
        """Determines the status unique lines versus all lcas.
2440
2441
        Basically, determines why the line is unique to this revision.
2442
2443
        A line may be determined new, killed, or both.
2444
3144.3.7 by Aaron Bentley
Update from review
2445
        If a line is determined new, that means it was not present in at least
2446
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2447
2448
        If a line is determined killed, that means the line was present in
2449
        at least one LCA.
2450
2451
        If a line is killed and new, this indicates that the two merge
2452
        revisions contain differing conflict resolutions.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2453
3144.3.7 by Aaron Bentley
Update from review
2454
        :param revision_id: The id of the revision in which the lines are
2455
            unique
2456
        :param unique_line_numbers: The line numbers of unique lines.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2457
        :return: a tuple of (new_this, killed_other)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2458
        """
2459
        new = set()
2460
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2461
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2462
        for lca in self.lcas:
2463
            blocks = self._get_matching_blocks(revision_id, lca)
2464
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2465
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2466
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2467
        return new, killed