/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
6379.6.1 by Jelmer Vernooij
Import absolute_import in a few places.
17
from __future__ import absolute_import
18
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
19
from .lazy_import import lazy_import
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
20
lazy_import(globals(), """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
21
from breezy import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
22
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
23
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
25
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
26
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
27
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
28
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
29
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
30
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
31
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
32
    textfile,
33
    trace,
34
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
35
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
36
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
37
    ui,
6670.4.3 by Jelmer Vernooij
Fix more imports.
38
    workingtree,
39
    )
40
from breezy.bzr import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
41
    versionedfile,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
42
    )
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
43
from breezy.i18n import gettext
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
44
""")
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
45
from . import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
46
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
47
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
48
    hooks,
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
49
    registry,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
50
    )
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
51
from .sixish import (
52
    viewitems,
53
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
54
# TODO: Report back as changes are merged in
55
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
56
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
57
def transform_tree(from_tree, to_tree, interesting_files=None):
7058.4.25 by Jelmer Vernooij
Use contexts.
58
    with from_tree.lock_tree_write():
59
        merge_inner(from_tree.branch, to_tree, from_tree,
7143.15.2 by Jelmer Vernooij
Run autopep8.
60
                    ignore_zero=True, this_tree=from_tree,
61
                    interesting_files=interesting_files)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
62
1457.1.12 by Robert Collins
Update comment to reflect author.
63
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
64
class MergeHooks(hooks.Hooks):
65
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
66
    def __init__(self):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
67
        hooks.Hooks.__init__(self, "breezy.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
68
        self.add_hook('merge_file_content',
7143.15.2 by Jelmer Vernooij
Run autopep8.
69
                      "Called with a breezy.merge.Merger object to create a per file "
70
                      "merge object when starting a merge. "
71
                      "Should return either None or a subclass of "
72
                      "``breezy.merge.AbstractPerFileMerger``. "
73
                      "Such objects will then be called per file "
74
                      "that needs to be merged (including when one "
75
                      "side has deleted the file and the other has changed it). "
76
                      "See the AbstractPerFileMerger API docs for details on how it is "
77
                      "used by merge.",
78
                      (2, 1))
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
79
        self.add_hook('pre_merge',
7143.15.2 by Jelmer Vernooij
Run autopep8.
80
                      'Called before a merge. '
81
                      'Receives a Merger object as the single argument.',
82
                      (2, 5))
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
83
        self.add_hook('post_merge',
7143.15.2 by Jelmer Vernooij
Run autopep8.
84
                      'Called after a merge. '
85
                      'Receives a Merger object as the single argument. '
86
                      'The return value is ignored.',
87
                      (2, 5))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
88
89
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
90
class AbstractPerFileMerger(object):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
91
    """PerFileMerger objects are used by plugins extending merge for breezy.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
92
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
93
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
94
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
95
    :ivar merger: The Merge3Merger performing the merge.
96
    """
97
98
    def __init__(self, merger):
99
        """Create a PerFileMerger for use with merger."""
100
        self.merger = merger
101
102
    def merge_contents(self, merge_params):
103
        """Attempt to merge the contents of a single file.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
104
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
105
        :param merge_params: A breezy.merge.MergeFileHookParams
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
106
        :return: A tuple of (status, chunks), where status is one of
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
107
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
108
            is 'success' or 'conflicted', then chunks should be an iterable of
109
            strings for the new file contents.
110
        """
111
        return ('not applicable', None)
112
113
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
114
class PerFileMerger(AbstractPerFileMerger):
115
    """Merge individual files when self.file_matches returns True.
116
117
    This class is intended to be subclassed.  The file_matches and
118
    merge_matching methods should be overridden with concrete implementations.
119
    """
120
121
    def file_matches(self, params):
122
        """Return True if merge_matching should be called on this file.
123
124
        Only called with merges of plain files with no clear winner.
125
126
        Subclasses must override this.
127
        """
128
        raise NotImplementedError(self.file_matches)
129
130
    def merge_contents(self, params):
131
        """Merge the contents of a single file."""
132
        # Check whether this custom merge logic should be used.
133
        if (
134
            # OTHER is a straight winner, rely on default merge.
135
            params.winner == 'other' or
136
            # THIS and OTHER aren't both files.
137
            not params.is_file_merge() or
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
138
            # The filename doesn't match
7143.15.2 by Jelmer Vernooij
Run autopep8.
139
                not self.file_matches(params)):
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
140
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
141
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
142
143
    def merge_matching(self, params):
144
        """Merge the contents of a single file that has matched the criteria
145
        in PerFileMerger.merge_contents (is a conflict, is a file,
146
        self.file_matches is True).
147
148
        Subclasses must override this.
149
        """
150
        raise NotImplementedError(self.merge_matching)
151
152
153
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
154
    """Merge individual files when configured via a .conf file.
155
156
    This is a base class for concrete custom file merging logic. Concrete
157
    classes should implement ``merge_text``.
158
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
159
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
160
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
161
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
162
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
163
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
164
        details. <name_prefix>_merge_files describes the files targeted by the
165
        hook for example.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
166
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
167
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
168
        is present.
169
    """
170
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
171
    name_prefix = None
172
    default_files = None
173
174
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
175
        super(ConfigurableFileMerger, self).__init__(merger)
176
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
177
        self.default_files = self.__class__.default_files or []
178
        self.name_prefix = self.__class__.name_prefix
179
        if self.name_prefix is None:
180
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
181
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
182
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
183
        """Check whether the file should call the merge hook.
184
185
        <name_prefix>_merge_files configuration variable is a list of files
186
        that should use the hook.
187
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
188
        affected_files = self.affected_files
189
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
190
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
191
            # Until bzr provides a better policy for caching the config, we
192
            # just add the part we're interested in to the params to avoid
6740.1.1 by Jelmer Vernooij
Rename bazaar.conf to breezy.conf.
193
            # reading the config files repeatedly (breezy.conf, location.conf,
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
194
            # branch.conf).
195
            config_key = self.name_prefix + '_merge_files'
196
            affected_files = config.get_user_option_as_list(config_key)
197
            if affected_files is None:
198
                # If nothing was specified in the config, use the default.
199
                affected_files = self.default_files
200
            self.affected_files = affected_files
201
        if affected_files:
6883.10.1 by Jelmer Vernooij
Fix more tets.
202
            filepath = params.this_path
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
203
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
204
                return True
205
        return False
206
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
207
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
208
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
209
210
    def merge_text(self, params):
211
        """Merge the byte contents of a single file.
212
213
        This is called after checking that the merge should be performed in
214
        merge_contents, and it should behave as per
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
215
        ``breezy.merge.AbstractPerFileMerger.merge_contents``.
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
216
        """
217
        raise NotImplementedError(self.merge_text)
218
219
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
220
class MergeFileHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
221
    """Object holding parameters passed to merge_file_content hooks.
222
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
223
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
224
225
    :ivar file_id: the file ID of the file being merged
6883.10.1 by Jelmer Vernooij
Fix more tets.
226
    :ivar base_path: Path in base tree
227
    :ivar other_path: Path in other tree
228
    :ivar this_path: Path in this tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
229
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
230
    :ivar this_kind: kind of file_id in 'this' tree
231
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
232
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
233
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
234
6883.10.1 by Jelmer Vernooij
Fix more tets.
235
    def __init__(self, merger, file_id, paths, trans_id, this_kind, other_kind,
7143.15.2 by Jelmer Vernooij
Run autopep8.
236
                 winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
237
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
238
        self.file_id = file_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
239
        self.paths = paths
240
        self.base_path, self.other_path, self.this_path = paths
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
241
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
242
        self.this_kind = this_kind
243
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
244
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
245
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
246
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
247
        """True if this_kind and other_kind are both 'file'."""
248
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
249
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
250
    @decorators.cachedproperty
251
    def base_lines(self):
252
        """The lines of the 'base' version of the file."""
7192.5.1 by Jelmer Vernooij
Remove more file ids.
253
        return self._merger.get_lines(self._merger.base_tree, self.base_path)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
254
255
    @decorators.cachedproperty
256
    def this_lines(self):
257
        """The lines of the 'this' version of the file."""
7192.5.1 by Jelmer Vernooij
Remove more file ids.
258
        return self._merger.get_lines(self._merger.this_tree, self.this_path)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
259
260
    @decorators.cachedproperty
261
    def other_lines(self):
262
        """The lines of the 'other' version of the file."""
7192.5.1 by Jelmer Vernooij
Remove more file ids.
263
        return self._merger.get_lines(self._merger.other_tree, self.other_path)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
264
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
265
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
266
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
267
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
268
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
269
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
270
    def __init__(self, this_branch, other_tree=None, base_tree=None,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
271
                 this_tree=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
272
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
273
        object.__init__(self)
274
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
275
        self.this_basis = _mod_revision.ensure_null(
276
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
277
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
278
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
279
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
280
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
281
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
282
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
283
        self.base_tree = base_tree
284
        self.ignore_zero = False
285
        self.backup_files = False
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
286
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
287
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
288
        self.reprocess = False
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
289
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
290
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
291
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
292
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
293
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
294
        self._base_is_ancestor = None
295
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
296
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
297
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
298
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
299
    def cache_trees_with_revision_ids(self, trees):
300
        """Cache any tree in trees if it has a revision_id."""
301
        for maybe_tree in trees:
302
            if maybe_tree is None:
303
                continue
304
            try:
305
                rev_id = maybe_tree.get_revision_id()
306
            except AttributeError:
307
                continue
308
            self._cached_trees[rev_id] = maybe_tree
309
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
310
    @property
311
    def revision_graph(self):
312
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
313
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
314
        return self._revision_graph
315
316
    def _set_base_is_ancestor(self, value):
317
        self._base_is_ancestor = value
318
319
    def _get_base_is_ancestor(self):
320
        if self._base_is_ancestor is None:
321
            self._base_is_ancestor = self.revision_graph.is_ancestor(
322
                self.base_rev_id, self.this_basis)
323
        return self._base_is_ancestor
324
325
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
326
327
    def _set_base_is_other_ancestor(self, value):
328
        self._base_is_other_ancestor = value
329
330
    def _get_base_is_other_ancestor(self):
331
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
332
            if self.other_basis is None:
333
                return True
334
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
335
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
336
        return self._base_is_other_ancestor
337
338
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
339
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
340
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
341
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
342
    def from_uncommitted(tree, other_tree, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
343
        """Return a Merger for uncommitted changes in other_tree.
344
345
        :param tree: The tree to merge into
346
        :param other_tree: The tree to get uncommitted changes from
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
347
        :param base_tree: The basis to use for the merge.  If unspecified,
348
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
349
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
350
        if base_tree is None:
351
            base_tree = other_tree.basis_tree()
6719.1.2 by Jelmer Vernooij
Fix some tests.
352
        merger = Merger(tree.branch, other_tree, base_tree, tree)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
353
        merger.base_rev_id = merger.base_tree.get_revision_id()
354
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
355
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
356
        return merger
357
358
    @classmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
359
    def from_mergeable(klass, tree, mergeable):
1551.15.74 by Aaron Bentley
Textual updates from review
360
        """Return a Merger for a bundle or merge directive.
361
362
        :param tree: The tree to merge changes into
363
        :param mergeable: A merge directive or bundle
364
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
365
        mergeable.install_revisions(tree.branch.repository)
366
        base_revision_id, other_revision_id, verified =\
367
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
368
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
369
        if base_revision_id is not None:
370
            if (base_revision_id != _mod_revision.NULL_REVISION and
371
                revision_graph.is_ancestor(
7143.15.2 by Jelmer Vernooij
Run autopep8.
372
                    base_revision_id, tree.branch.last_revision())):
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
373
                base_revision_id = None
374
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
375
                trace.warning('Performing cherrypick')
6719.1.2 by Jelmer Vernooij
Fix some tests.
376
        merger = klass.from_revision_ids(tree, other_revision_id,
7143.15.2 by Jelmer Vernooij
Run autopep8.
377
                                         base_revision_id, revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
378
        return merger, verified
379
380
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
381
    def from_revision_ids(tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
382
                          base_branch=None, revision_graph=None,
383
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
384
        """Return a Merger for revision-ids.
385
386
        :param tree: The tree to merge changes into
387
        :param other: The revision-id to use as OTHER
388
        :param base: The revision-id to use as BASE.  If not specified, will
389
            be auto-selected.
390
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
391
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
392
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
393
            not supplied, other_branch or tree.branch will be used.
394
        :param revision_graph: If you have a revision_graph precomputed, pass
395
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
396
        :param tree_branch: The branch associated with tree.  If not supplied,
397
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
398
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
399
        if tree_branch is None:
400
            tree_branch = tree.branch
6719.1.2 by Jelmer Vernooij
Fix some tests.
401
        merger = Merger(tree_branch, this_tree=tree,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
402
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
403
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
404
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
405
        merger.set_other_revision(other, other_branch)
406
        if base is None:
407
            merger.find_base()
408
        else:
409
            if base_branch is None:
410
                base_branch = other_branch
411
            merger.set_base_revision(base, base_branch)
412
        return merger
413
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
414
    def revision_tree(self, revision_id, branch=None):
415
        if revision_id not in self._cached_trees:
416
            if branch is None:
417
                branch = self.this_branch
418
            try:
419
                tree = self.this_tree.revision_tree(revision_id)
420
            except errors.NoSuchRevisionInTree:
421
                tree = branch.repository.revision_tree(revision_id)
422
            self._cached_trees[revision_id] = tree
423
        return self._cached_trees[revision_id]
424
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
425
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
426
        location, revno = treespec
427
        if revno is None:
428
            tree = workingtree.WorkingTree.open_containing(location)[0]
429
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
430
        branch = _mod_branch.Branch.open_containing(
431
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
432
        if revno == -1:
433
            revision_id = branch.last_revision()
434
        else:
435
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
436
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
437
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
438
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
439
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
440
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
441
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
442
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
443
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
7143.15.2 by Jelmer Vernooij
Run autopep8.
444
                or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
445
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
446
        self._add_parent()
447
448
    def _add_parent(self):
449
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
450
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
451
        operation = cleanup.OperationWithCleanups(
452
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
453
        for revision_id in new_parents:
454
            try:
455
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
456
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
457
                tree = None
458
            else:
459
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
460
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
461
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
462
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
463
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
464
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
465
        """Set the revision and tree to merge from.
466
467
        This sets the other_tree, other_rev_id, other_basis attributes.
468
469
        :param other_revision: The [path, revision] list to merge from.
470
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
471
        self.other_branch, self.other_tree = self._get_tree(other_revision,
472
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
473
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
474
            self.other_rev_id = _mod_revision.ensure_null(
475
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
476
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
477
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
478
            self.other_basis = self.other_rev_id
479
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
480
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
481
            self.other_basis = self.other_rev_id
482
        else:
483
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
484
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
485
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
486
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
487
        if self.other_rev_id is not None:
488
            self._cached_trees[self.other_rev_id] = self.other_tree
7143.15.2 by Jelmer Vernooij
Run autopep8.
489
        self._maybe_fetch(self.other_branch,
490
                          self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
491
2100.3.29 by Aaron Bentley
Get merge working initially
492
    def set_other_revision(self, revision_id, other_branch):
493
        """Set 'other' based on a branch and revision id
494
495
        :param revision_id: The revision to use for a tree
496
        :param other_branch: The branch containing this tree
497
        """
498
        self.other_rev_id = revision_id
499
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
500
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
501
        self.other_tree = self.revision_tree(revision_id)
502
        self.other_basis = revision_id
503
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
504
    def set_base_revision(self, revision_id, branch):
505
        """Set 'base' based on a branch and revision id
506
507
        :param revision_id: The revision to use for a tree
508
        :param branch: The branch containing this tree
509
        """
510
        self.base_rev_id = revision_id
511
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
512
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
513
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
514
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
515
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
516
        if not source.repository.has_same_location(target.repository):
5741.1.9 by Jelmer Vernooij
Remove fetch_tags argument.
517
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
518
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
519
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
520
        revisions = [_mod_revision.ensure_null(self.this_basis),
521
                     _mod_revision.ensure_null(self.other_basis)]
522
        if _mod_revision.NULL_REVISION in revisions:
523
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
524
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
525
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
526
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
527
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
528
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
529
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
530
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
531
            elif len(lcas) == 1:
532
                self.base_rev_id = list(lcas)[0]
7143.15.2 by Jelmer Vernooij
Run autopep8.
533
            else:  # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
534
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
535
                if len(lcas) > 2:
536
                    # find_unique_lca can only handle 2 nodes, so we have to
537
                    # start back at the beginning. It is a shame to traverse
538
                    # the graph again, but better than re-implementing
539
                    # find_unique_lca.
540
                    self.base_rev_id = self.revision_graph.find_unique_lca(
7143.15.2 by Jelmer Vernooij
Run autopep8.
541
                        revisions[0], revisions[1])
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
542
                else:
543
                    self.base_rev_id = self.revision_graph.find_unique_lca(
7143.15.2 by Jelmer Vernooij
Run autopep8.
544
                        *lcas)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
545
                sorted_lca_keys = self.revision_graph.find_merge_order(
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
546
                    revisions[0], lcas)
547
                if self.base_rev_id == _mod_revision.NULL_REVISION:
548
                    self.base_rev_id = sorted_lca_keys[0]
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
549
4721.3.1 by Vincent Ladeuil
Cleanup imports.
550
            if self.base_rev_id == _mod_revision.NULL_REVISION:
551
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
552
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
553
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
554
                              ' help criss-cross.')
555
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
556
                if self.base_rev_id in lcas:
557
                    trace.mutter('Unable to find unique lca. '
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
558
                                 'Fallback %r as best option.'
559
                                 % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
560
                interesting_revision_ids = set(lcas)
561
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
562
                interesting_trees = dict((t.get_revision_id(), t)
7143.15.2 by Jelmer Vernooij
Run autopep8.
563
                                         for t in self.this_branch.repository.revision_trees(
564
                    interesting_revision_ids))
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
565
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
566
                if self.base_rev_id in lcas:
567
                    self.base_tree = interesting_trees[self.base_rev_id]
568
                else:
569
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
570
                self._lca_trees = [interesting_trees[key]
571
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
572
            else:
573
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
574
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
575
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
576
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
577
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
578
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
579
        """Set the base revision to use for the merge.
580
581
        :param base_revision: A 2-list containing a path and revision number.
582
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
583
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
584
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
585
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
586
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
587
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
588
            if base_revision[1] == -1:
589
                self.base_rev_id = base_branch.last_revision()
590
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
591
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
592
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
593
                self.base_rev_id = _mod_revision.ensure_null(
594
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
595
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
596
3008.1.8 by Michael Hudson
extract merger creation into a method
597
    def make_merger(self):
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
598
        kwargs = {'working_tree': self.this_tree, 'this_tree': self.this_tree,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
599
                  'other_tree': self.other_tree,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
600
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
601
                  'this_branch': self.this_branch,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
602
                  'other_branch': self.other_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
603
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
604
        if self.merge_type.requires_base:
605
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
606
        if self.merge_type.supports_reprocess:
607
            kwargs['reprocess'] = self.reprocess
608
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
609
            raise errors.BzrError(
610
                "Conflict reduction is not supported for merge"
611
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
612
        if self.merge_type.supports_show_base:
613
            kwargs['show_base'] = self.show_base
614
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
615
            raise errors.BzrError("Showing base is not supported for this"
616
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
617
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
7143.15.2 by Jelmer Vernooij
Run autopep8.
618
                and not self.base_is_other_ancestor):
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
619
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
620
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
621
            kwargs['cherrypick'] = (not self.base_is_ancestor or
622
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
623
        if self._is_criss_cross and getattr(self.merge_type,
624
                                            'supports_lca_trees', False):
625
            kwargs['lca_trees'] = self._lca_trees
6719.1.2 by Jelmer Vernooij
Fix some tests.
626
        return self.merge_type(change_reporter=self.change_reporter,
3008.1.8 by Michael Hudson
extract merger creation into a method
627
                               **kwargs)
628
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
629
    def _do_merge_to(self):
630
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
631
        if self.other_branch is not None:
632
            self.other_branch.update_references(self.this_branch)
6388.1.4 by Jelmer Vernooij
Fix tests.
633
        for hook in Merger.hooks['pre_merge']:
634
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
635
        merge.do_merge()
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
636
        for hook in Merger.hooks['post_merge']:
637
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
638
        if self.recurse == 'down':
639
            for relpath, file_id in self.this_tree.iter_references():
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
640
                sub_tree = self.this_tree.get_nested_tree(relpath)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
641
                other_revision = self.other_tree.get_reference_revision(
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
642
                    relpath)
7143.15.2 by Jelmer Vernooij
Run autopep8.
643
                if other_revision == sub_tree.last_revision():
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
644
                    continue
645
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
646
                sub_merge.merge_type = self.merge_type
6926.2.5 by Jelmer Vernooij
Swap order for nested tree functions.
647
                other_branch = self.other_branch.reference_parent(
648
                    relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
649
                sub_merge.set_other_revision(other_revision, other_branch)
6883.5.3 by Jelmer Vernooij
Add find_previous_path.
650
                base_tree_path = _mod_tree.find_previous_path(
651
                    self.this_tree, self.base_tree, relpath)
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
652
                base_revision = self.base_tree.get_reference_revision(
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
653
                    base_tree_path)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
654
                sub_merge.base_tree = \
655
                    sub_tree.branch.repository.revision_tree(base_revision)
656
                sub_merge.base_rev_id = base_revision
657
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
658
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
659
3008.1.8 by Michael Hudson
extract merger creation into a method
660
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
661
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
662
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
663
        operation.add_cleanup(self.this_tree.unlock)
664
        if self.base_tree is not None:
665
            self.base_tree.lock_read()
666
            operation.add_cleanup(self.base_tree.unlock)
667
        if self.other_tree is not None:
668
            self.other_tree.lock_read()
669
            operation.add_cleanup(self.other_tree.unlock)
670
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
671
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
672
            if not self.ignore_zero and not trace.is_quiet():
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
673
                trace.note(gettext("All changes applied successfully."))
1534.7.141 by Aaron Bentley
Added conflict reporting
674
        else:
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
675
            trace.note(gettext("%d conflicts encountered.")
4721.3.1 by Vincent Ladeuil
Cleanup imports.
676
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
677
1534.7.134 by Aaron Bentley
Hid raw conflicts
678
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
679
1545.2.4 by Aaron Bentley
PEP8 fixes
680
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
681
class _InventoryNoneEntry(object):
682
    """This represents an inventory entry which *isn't there*.
683
684
    It simplifies the merging logic if we always have an InventoryEntry, even
685
    if it isn't actually present
686
    """
687
    executable = None
688
    kind = None
689
    name = None
690
    parent_id = None
691
    revision = None
692
    symlink_target = None
693
    text_sha1 = None
694
7143.15.2 by Jelmer Vernooij
Run autopep8.
695
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
696
_none_entry = _InventoryNoneEntry()
697
698
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
699
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
700
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
701
    requires_base = True
702
    supports_reprocess = True
703
    supports_show_base = True
704
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
705
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
706
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
707
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
708
    supports_lca_trees = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
709
    requires_file_merge_plan = False
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
710
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
711
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
712
                 reprocess=False, show_base=False,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
713
                 change_reporter=None, interesting_files=None, do_merge=True,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
714
                 cherrypick=False, lca_trees=None, this_branch=None,
715
                 other_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
716
        """Initialize the merger object and perform the merge.
717
718
        :param working_tree: The working tree to apply the merge to
719
        :param this_tree: The local tree in the merge operation
720
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
721
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
722
        :param this_branch: The branch associated with this_tree.  Defaults to
723
            this_tree.branch if not supplied.
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
724
        :param other_branch: The branch associated with other_tree, if any.
2590.2.10 by Aaron Bentley
Updates from review
725
        :param: reprocess If True, perform conflict-reduction processing.
726
        :param show_base: If True, show the base revision in text conflicts.
727
            (incompatible with reprocess)
728
        :param change_reporter: An object that should report changes made
729
        :param interesting_files: The tree-relative paths of files that should
730
            participate in the merge.  If these paths refer to directories,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
731
            the contents of those directories will also be included.  If not
732
            specified, all files may participate in the
2590.2.10 by Aaron Bentley
Updates from review
733
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
734
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
735
            if the ancestry was found to include a criss-cross merge.
736
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
737
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
738
        object.__init__(self)
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
739
        if this_branch is None:
740
            this_branch = this_tree.branch
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
741
        self.interesting_files = interesting_files
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
742
        self.working_tree = working_tree
743
        self.this_tree = this_tree
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
744
        self.base_tree = base_tree
745
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
746
        self.this_branch = this_branch
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
747
        self.other_branch = other_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
748
        self._raw_conflicts = []
749
        self.cooked_conflicts = []
750
        self.reprocess = reprocess
751
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
752
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
753
        # Uncommenting this will change the default algorithm to always use
754
        # _entries_lca. This can be useful for running the test suite and
755
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
756
        # if lca_trees is None:
757
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
758
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
759
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
760
        if do_merge:
761
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
762
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
763
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
764
        operation = cleanup.OperationWithCleanups(self._do_merge)
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
765
        self.working_tree.lock_tree_write()
766
        operation.add_cleanup(self.working_tree.unlock)
767
        self.this_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
768
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
769
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
770
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
771
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
772
        operation.add_cleanup(self.other_tree.unlock)
773
        operation.run()
774
775
    def _do_merge(self, operation):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
776
        self.tt = transform.TreeTransform(self.working_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
777
        operation.add_cleanup(self.tt.finalize)
778
        self._compute_transform()
779
        results = self.tt.apply(no_conflicts=True)
780
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
781
        try:
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
782
            self.working_tree.add_conflicts(self.cooked_conflicts)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
783
        except errors.UnsupportedOperation:
784
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
785
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
786
    def make_preview_transform(self):
7058.4.25 by Jelmer Vernooij
Use contexts.
787
        with self.base_tree.lock_read(), self.other_tree.lock_read():
788
            self.tt = transform.TransformPreview(self.working_tree)
789
            self._compute_transform()
790
            return self.tt
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
791
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
792
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
793
        if self._lca_trees is None:
794
            entries = self._entries3()
795
            resolver = self._three_way
796
        else:
797
            entries = self._entries_lca()
798
            resolver = self._lca_multi_way
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
799
        # Prepare merge hooks
800
        factories = Merger.hooks['merge_file_content']
801
        # One hook for each registered one plus our default merger
802
        hooks = [factory(self) for factory in factories] + [self]
803
        self.active_hooks = [hook for hook in hooks if hook is not None]
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
804
        with ui.ui_factory.nested_progress_bar() as child_pb:
6883.10.1 by Jelmer Vernooij
Fix more tets.
805
            for num, (file_id, changed, paths3, parents3, names3,
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
806
                      executable3) in enumerate(entries):
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
807
                # Try merging each entry
808
                child_pb.update(gettext('Preparing file merge'),
809
                                num, len(entries))
7143.15.2 by Jelmer Vernooij
Run autopep8.
810
                self._merge_names(file_id, paths3, parents3,
811
                                  names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
812
                if changed:
6883.10.1 by Jelmer Vernooij
Fix more tets.
813
                    file_status = self._do_merge_contents(paths3, file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
814
                else:
815
                    file_status = 'unmodified'
6883.10.1 by Jelmer Vernooij
Fix more tets.
816
                self._merge_executable(paths3, file_id, executable3,
7143.15.2 by Jelmer Vernooij
Run autopep8.
817
                                       file_status, resolver=resolver)
5993.2.4 by Jelmer Vernooij
Remove feature flag.
818
        self.tt.fixup_new_roots()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
819
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
820
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
821
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
822
        """Finalize the transform and report the changes.
823
824
        This is the second half of _compute_transform.
825
        """
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
826
        with ui.ui_factory.nested_progress_bar() as child_pb:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
827
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
7143.15.2 by Jelmer Vernooij
Run autopep8.
828
                                                       lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
829
        if self.change_reporter is not None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
830
            from breezy import delta
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
831
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
832
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
833
        self.cook_conflicts(fs_conflicts)
834
        for conflict in self.cooked_conflicts:
6973.6.4 by Jelmer Vernooij
Avoid text_type()
835
            trace.warning('%s', conflict.describe())
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
836
2590.2.4 by Aaron Bentley
Move entry generation to a helper
837
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
838
        """Gather data about files modified between three trees.
839
840
        Return a list of tuples of file_id, changed, parents3, names3,
841
        executable3.  changed is a boolean indicating whether the file contents
842
        or kind were changed.  parents3 is a tuple of parent ids for base,
843
        other and this.  names3 is a tuple of names for base, other and this.
844
        executable3 is a tuple of execute-bit values for base, other and this.
845
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
846
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
847
        iterator = self.other_tree.iter_changes(self.base_tree,
7143.15.2 by Jelmer Vernooij
Run autopep8.
848
                                                specific_files=self.interesting_files,
849
                                                extra_trees=[self.this_tree])
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
850
        this_interesting_files = self.this_tree.find_related_paths_across_trees(
7143.15.2 by Jelmer Vernooij
Run autopep8.
851
            self.interesting_files, trees=[self.other_tree])
6883.10.1 by Jelmer Vernooij
Fix more tets.
852
        this_entries = dict(self.this_tree.iter_entries_by_dir(
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
853
                            specific_files=this_interesting_files))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
854
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
855
             executable) in iterator:
6883.10.2 by Jelmer Vernooij
Resolve TODO
856
            if paths[0] is not None:
857
                this_path = _mod_tree.find_previous_path(
7143.15.2 by Jelmer Vernooij
Run autopep8.
858
                    self.base_tree, self.this_tree, paths[0])
6883.10.1 by Jelmer Vernooij
Fix more tets.
859
            else:
6883.10.2 by Jelmer Vernooij
Resolve TODO
860
                this_path = _mod_tree.find_previous_path(
7143.15.2 by Jelmer Vernooij
Run autopep8.
861
                    self.other_tree, self.this_tree, paths[1])
6883.10.2 by Jelmer Vernooij
Resolve TODO
862
            this_entry = this_entries.get(this_path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
863
            if this_entry is not None:
864
                this_name = this_entry.name
865
                this_parent = this_entry.parent_id
866
                this_executable = this_entry.executable
2590.2.4 by Aaron Bentley
Move entry generation to a helper
867
            else:
868
                this_name = None
869
                this_parent = None
870
                this_executable = None
871
            parents3 = parents + (this_parent,)
872
            names3 = names + (this_name,)
6883.10.1 by Jelmer Vernooij
Fix more tets.
873
            paths3 = paths + (this_path, )
2590.2.4 by Aaron Bentley
Move entry generation to a helper
874
            executable3 = executable + (this_executable,)
7143.15.2 by Jelmer Vernooij
Run autopep8.
875
            result.append((file_id, changed, paths3,
876
                           parents3, names3, executable3))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
877
        return result
878
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
879
    def _entries_lca(self):
880
        """Gather data about files modified between multiple trees.
881
882
        This compares OTHER versus all LCA trees, and for interesting entries,
883
        it then compares with THIS and BASE.
884
885
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
886
6883.10.1 by Jelmer Vernooij
Fix more tets.
887
        :return: [(file_id, changed, paths, parents, names, executable)], where:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
888
889
            * file_id: Simple file_id of the entry
890
            * changed: Boolean, True if the kind or contents changed else False
6883.10.1 by Jelmer Vernooij
Fix more tets.
891
            * paths: ((base, [path, in, lcas]), path_other, path_this)
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
892
            * parents: ((base, [parent_id, in, lcas]), parent_id_other,
893
                        parent_id_this)
894
            * names:   ((base, [name, in, lcas]), name_in_other, name_in_this)
895
            * executable: ((base, [exec, in, lcas]), exec_in_other,
896
                        exec_in_this)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
897
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
898
        if self.interesting_files is not None:
899
            lookup_trees = [self.this_tree, self.base_tree]
900
            lookup_trees.extend(self._lca_trees)
901
            # I think we should include the lca trees as well
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
902
            interesting_files = self.other_tree.find_related_paths_across_trees(
7143.15.2 by Jelmer Vernooij
Run autopep8.
903
                self.interesting_files, lookup_trees)
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
904
        else:
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
905
            interesting_files = None
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
906
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
907
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
908
6405.2.10 by Jelmer Vernooij
Fix more tests.
909
        base_inventory = self.base_tree.root_inventory
910
        this_inventory = self.this_tree.root_inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
911
        for path, file_id, other_ie, lca_values in walker.iter_all():
912
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
913
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
914
                other_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
915
                other_path = None
916
            else:
917
                other_path = self.other_tree.id2path(file_id)
6883.10.3 by Jelmer Vernooij
Merge trunk.
918
            if interesting_files is not None and other_path not in interesting_files:
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
919
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
920
3514.4.30 by John Arbash Meinel
Several updates.
921
            # If other_revision is found in any of the lcas, that means this
922
            # node is uninteresting. This is because when merging, if there are
923
            # multiple heads(), we have to create a new node. So if we didn't,
924
            # we know that the ancestry is linear, and that OTHER did not
925
            # modify anything
926
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
927
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
928
            if other_revision is not None:
929
                # We can't use this shortcut when other_revision is None,
930
                # because it may be None because things are WorkingTrees, and
931
                # not because it is *actually* None.
932
                is_unmodified = False
933
                for lca_path, ie in lca_values:
934
                    if ie is not None and ie.revision == other_revision:
935
                        is_unmodified = True
936
                        break
937
                if is_unmodified:
938
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
939
940
            lca_entries = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
941
            lca_paths = []
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
942
            for lca_path, lca_ie in lca_values:
943
                if lca_ie is None:
944
                    lca_entries.append(_none_entry)
6883.10.1 by Jelmer Vernooij
Fix more tets.
945
                    lca_paths.append(None)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
946
                else:
947
                    lca_entries.append(lca_ie)
6928.1.2 by Jelmer Vernooij
Fix path specification.
948
                    lca_paths.append(lca_path)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
949
6883.7.12 by Jelmer Vernooij
avoid has_id.
950
            try:
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
951
                base_ie = base_inventory.get_entry(file_id)
6883.7.12 by Jelmer Vernooij
avoid has_id.
952
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
953
                base_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
954
                base_path = None
955
            else:
956
                base_path = self.base_tree.id2path(file_id)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
957
6883.7.12 by Jelmer Vernooij
avoid has_id.
958
            try:
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
959
                this_ie = this_inventory.get_entry(file_id)
6883.7.12 by Jelmer Vernooij
avoid has_id.
960
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
961
                this_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
962
                this_path = None
963
            else:
964
                this_path = self.this_tree.id2path(file_id)
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
965
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
966
            lca_kinds = []
967
            lca_parent_ids = []
968
            lca_names = []
969
            lca_executable = []
970
            for lca_ie in lca_entries:
971
                lca_kinds.append(lca_ie.kind)
972
                lca_parent_ids.append(lca_ie.parent_id)
973
                lca_names.append(lca_ie.name)
974
                lca_executable.append(lca_ie.executable)
975
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
976
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
977
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
978
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
979
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
980
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
981
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
982
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
983
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
984
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
985
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
986
            content_changed = True
987
            if kind_winner == 'this':
988
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
989
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
990
                    if parent_id_winner == 'this' and name_winner == 'this':
991
                        # No change for this directory in OTHER, skip
992
                        continue
993
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
994
                elif other_ie.kind is None or other_ie.kind == 'file':
6883.10.1 by Jelmer Vernooij
Fix more tets.
995
                    def get_sha1(tree, path):
996
                        if path is None:
997
                            return None
998
                        try:
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
999
                            return tree.get_file_sha1(path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1000
                        except errors.NoSuchFile:
1001
                            return None
1002
                    base_sha1 = get_sha1(self.base_tree, base_path)
6928.1.2 by Jelmer Vernooij
Fix path specification.
1003
                    lca_sha1s = [get_sha1(tree, lca_path)
1004
                                 for tree, lca_path
6883.10.1 by Jelmer Vernooij
Fix more tets.
1005
                                 in zip(self._lca_trees, lca_paths)]
1006
                    this_sha1 = get_sha1(self.this_tree, this_path)
1007
                    other_sha1 = get_sha1(self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1008
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1009
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1010
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1011
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1012
                        (base_ie.executable, lca_executable),
1013
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1014
                    if (parent_id_winner == 'this' and name_winner == 'this'
7143.15.2 by Jelmer Vernooij
Run autopep8.
1015
                            and sha1_winner == 'this' and exec_winner == 'this'):
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1016
                        # No kind, parent, name, exec, or content change for
1017
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1018
                        continue
1019
                    if sha1_winner == 'this':
1020
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1021
                elif other_ie.kind == 'symlink':
6883.10.1 by Jelmer Vernooij
Fix more tets.
1022
                    def get_target(ie, tree, path):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1023
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1024
                            return None
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1025
                        return tree.get_symlink_target(path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1026
                    base_target = get_target(base_ie, self.base_tree, base_path)
1027
                    lca_targets = [get_target(ie, tree, lca_path) for ie, tree, lca_path
1028
                                   in zip(lca_entries, self._lca_trees, lca_paths)]
7143.15.2 by Jelmer Vernooij
Run autopep8.
1029
                    this_target = get_target(
1030
                        this_ie, self.this_tree, this_path)
1031
                    other_target = get_target(
1032
                        other_ie, self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1033
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1034
                        (base_target, lca_targets),
1035
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1036
                    if (parent_id_winner == 'this' and name_winner == 'this'
7143.15.2 by Jelmer Vernooij
Run autopep8.
1037
                            and target_winner == 'this'):
3514.4.28 by John Arbash Meinel
More symlink tests.
1038
                        # No kind, parent, name, or symlink target change
1039
                        # not interesting
1040
                        continue
1041
                    if target_winner == 'this':
1042
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1043
                elif other_ie.kind == 'tree-reference':
1044
                    # The 'changed' information seems to be handled at a higher
1045
                    # level. At least, _entries3 returns False for content
1046
                    # changed, even when at a new revision_id.
1047
                    content_changed = False
1048
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1049
                        # Nothing interesting
1050
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1051
                else:
1052
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1053
1054
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1055
            result.append((file_id, content_changed,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1056
                           ((base_path, lca_paths),
1057
                            other_path, this_path),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1058
                           ((base_ie.parent_id, lca_parent_ids),
1059
                            other_ie.parent_id, this_ie.parent_id),
1060
                           ((base_ie.name, lca_names),
1061
                            other_ie.name, this_ie.name),
1062
                           ((base_ie.executable, lca_executable),
1063
                            other_ie.executable, this_ie.executable)
7143.15.2 by Jelmer Vernooij
Run autopep8.
1064
                           ))
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1065
        return result
1066
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1067
    def write_modified(self, results):
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1068
        if not self.working_tree.supports_merge_modified():
1069
            return
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1070
        modified_hashes = {}
1071
        for path in results.modified_paths:
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1072
            wt_relpath = self.working_tree.relpath(path)
1073
            file_id = self.working_tree.path2id(wt_relpath)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1074
            if file_id is None:
1075
                continue
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1076
            hash = self.working_tree.get_file_sha1(wt_relpath)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1077
            if hash is None:
1078
                continue
1079
            modified_hashes[file_id] = hash
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1080
        self.working_tree.set_merge_modified(modified_hashes)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1081
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1082
    @staticmethod
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1083
    def parent(entry):
1534.7.157 by Aaron Bentley
Added more docs
1084
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1085
        if entry is None:
1086
            return None
1087
        return entry.parent_id
1088
1089
    @staticmethod
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1090
    def name(entry):
1534.7.157 by Aaron Bentley
Added more docs
1091
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1092
        if entry is None:
1093
            return None
1094
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1095
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1096
    @staticmethod
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1097
    def contents_sha1(tree, path):
1534.7.157 by Aaron Bentley
Added more docs
1098
        """Determine the sha1 of the file contents (used as a key method)."""
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1099
        try:
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1100
            return tree.get_file_sha1(path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1101
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1102
            return None
1103
1104
    @staticmethod
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1105
    def executable(tree, path):
1534.7.157 by Aaron Bentley
Added more docs
1106
        """Determine the executability of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1107
        try:
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1108
            if tree.kind(path) != "file":
6883.10.1 by Jelmer Vernooij
Fix more tets.
1109
                return False
1110
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1111
            return None
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1112
        return tree.is_executable(path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1113
1114
    @staticmethod
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1115
    def kind(tree, path):
1534.7.157 by Aaron Bentley
Added more docs
1116
        """Determine the kind of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1117
        try:
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1118
            return tree.kind(path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1119
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1120
            return None
1121
1122
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1123
    def _three_way(base, other, this):
1124
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1125
            # if 'base == other', either they all agree, or only 'this' has
1126
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1127
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1128
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1129
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1130
            return 'conflict'
1131
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1132
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1133
            return "this"
1134
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1135
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1136
            return "other"
1137
1138
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1139
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1140
        """Consider LCAs when determining whether a change has occurred.
1141
1142
        If LCAS are all identical, this is the same as a _three_way comparison.
1143
1144
        :param bases: value in (BASE, [LCAS])
1145
        :param other: value in OTHER
1146
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1147
        :param allow_overriding_lca: If there is more than one unique lca
1148
            value, allow OTHER to override THIS if it has a new value, and
1149
            THIS only has an lca value, or vice versa. This is appropriate for
1150
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1151
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1152
            changed or not.
1153
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1154
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1155
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1156
        if other == this:
1157
            # Either Ambiguously clean, or nothing was actually changed. We
1158
            # don't really care
1159
            return 'this'
1160
        base_val, lca_vals = bases
1161
        # Remove 'base_val' from the lca_vals, because it is not interesting
1162
        filtered_lca_vals = [lca_val for lca_val in lca_vals
7143.15.2 by Jelmer Vernooij
Run autopep8.
1163
                             if lca_val != base_val]
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1164
        if len(filtered_lca_vals) == 0:
1165
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1166
1167
        unique_lca_vals = set(filtered_lca_vals)
1168
        if len(unique_lca_vals) == 1:
1169
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1170
1171
        if allow_overriding_lca:
1172
            if other in unique_lca_vals:
1173
                if this in unique_lca_vals:
1174
                    # Each side picked a different lca, conflict
1175
                    return 'conflict'
1176
                else:
1177
                    # This has a value which supersedes both lca values, and
1178
                    # other only has an lca value
1179
                    return 'this'
1180
            elif this in unique_lca_vals:
1181
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1182
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1183
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1184
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1185
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1186
        return 'conflict'
1187
6883.10.1 by Jelmer Vernooij
Fix more tets.
1188
    def _merge_names(self, file_id, paths, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1189
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1190
        base_name, other_name, this_name = names
1191
        base_parent, other_parent, this_parent = parents
6883.10.1 by Jelmer Vernooij
Fix more tets.
1192
        unused_base_path, other_path, this_path = paths
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1193
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1194
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1195
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1196
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1197
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1198
            if name_winner == "this":
1199
                name_winner = "other"
1200
            if parent_id_winner == "this":
1201
                parent_id_winner = "other"
1202
        if name_winner == "this" and parent_id_winner == "this":
1203
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1204
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1205
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1206
            # road if a ContentConflict needs to be created so we should not do
1207
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1208
            trans_id = self.tt.trans_id_file_id(file_id)
1209
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1210
                                        this_parent, this_name,
1211
                                        other_parent, other_name))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1212
        if other_path is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1213
            # it doesn't matter whether the result was 'other' or
5954.4.6 by Aaron Bentley
Updates from review.
1214
            # 'conflict'-- if it has no file id, we leave it alone.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1215
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1216
        parent_id = parents[self.winner_idx[parent_id_winner]]
5954.4.2 by Aaron Bentley
Support merging into null tree.
1217
        name = names[self.winner_idx[name_winner]]
1218
        if parent_id is not None or name is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1219
            # if we get here, name_winner and parent_winner are set to safe
1220
            # values.
5954.4.2 by Aaron Bentley
Support merging into null tree.
1221
            if parent_id is None and name is not None:
1222
                # if parent_id is None and name is non-None, current file is
1223
                # the tree root.
1224
                if names[self.winner_idx[parent_id_winner]] != '':
1225
                    raise AssertionError(
1226
                        'File looks like a root, but named %s' %
1227
                        names[self.winner_idx[parent_id_winner]])
1228
                parent_trans_id = transform.ROOT_PARENT
1229
            else:
1230
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1231
            self.tt.adjust_path(name, parent_trans_id,
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1232
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1233
6883.10.1 by Jelmer Vernooij
Fix more tets.
1234
    def _do_merge_contents(self, paths, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1235
        """Performs a merge on file_id contents."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1236
        def contents_pair(tree, path):
1237
            if path is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1238
                return (None, None)
6809.4.17 by Jelmer Vernooij
One more :)
1239
            try:
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1240
                kind = tree.kind(path)
6809.4.17 by Jelmer Vernooij
One more :)
1241
            except errors.NoSuchFile:
1242
                return (None, None)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1243
            if kind == "file":
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1244
                contents = tree.get_file_sha1(path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1245
            elif kind == "symlink":
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1246
                contents = tree.get_symlink_target(path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1247
            else:
1248
                contents = None
1249
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1250
6883.10.1 by Jelmer Vernooij
Fix more tets.
1251
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1252
        # See SPOT run.  run, SPOT, run.
1253
        # So we're not QUITE repeating ourselves; we do tricky things with
1254
        # file kind...
6883.10.1 by Jelmer Vernooij
Fix more tets.
1255
        other_pair = contents_pair(self.other_tree, other_path)
1256
        this_pair = contents_pair(self.this_tree, this_path)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1257
        if self._lca_trees:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1258
            (base_path, lca_paths) = base_path
1259
            base_pair = contents_pair(self.base_tree, base_path)
1260
            lca_pairs = [contents_pair(tree, path)
1261
                         for tree, path in zip(self._lca_trees, lca_paths)]
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1262
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1263
                                         this_pair, allow_overriding_lca=False)
1264
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1265
            base_pair = contents_pair(self.base_tree, base_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1266
            if base_pair == other_pair:
1267
                winner = 'this'
1268
            else:
1269
                # We delayed evaluating this_pair as long as we can to avoid
1270
                # unnecessary sha1 calculation
6883.10.1 by Jelmer Vernooij
Fix more tets.
1271
                this_pair = contents_pair(self.this_tree, this_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1272
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1273
        if winner == 'this':
1274
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1275
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1276
        # We have a hypothetical conflict, but if we have files, then we
1277
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1278
        trans_id = self.tt.trans_id_file_id(file_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1279
        params = MergeFileHookParams(
1280
            self, file_id, (base_path, other_path,
7143.15.2 by Jelmer Vernooij
Run autopep8.
1281
                            this_path), trans_id, this_pair[0],
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1282
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1283
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1284
        hook_status = 'not_applicable'
1285
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1286
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1287
            if hook_status != 'not_applicable':
1288
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1289
                break
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1290
        # If the merge ends up replacing the content of the file, we get rid of
1291
        # it at the end of this method (this variable is used to track the
1292
        # exceptions to this rule).
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1293
        keep_this = False
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1294
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1295
        if hook_status == 'not_applicable':
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1296
            # No merge hook was able to resolve the situation. Two cases exist:
1297
            # a content conflict or a duplicate one.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1298
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1299
            name = self.tt.final_name(trans_id)
1300
            parent_id = self.tt.final_parent(trans_id)
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1301
            inhibit_content_conflict = False
7143.15.2 by Jelmer Vernooij
Run autopep8.
1302
            if params.this_kind is None:  # file_id is not in THIS
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1303
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1304
                if self.this_tree.is_versioned(other_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1305
                    # Two entries for the same path
1306
                    keep_this = True
1307
                    # versioning the merged file will trigger a duplicate
1308
                    # conflict
1309
                    self.tt.version_file(file_id, trans_id)
1310
                    transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1311
                        self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1312
                        other_path, file_id=file_id,
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1313
                        filter_tree_path=self._get_filter_tree_path(file_id))
1314
                    inhibit_content_conflict = True
7143.15.2 by Jelmer Vernooij
Run autopep8.
1315
            elif params.other_kind is None:  # file_id is not in OTHER
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1316
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1317
                if self.other_tree.is_versioned(this_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1318
                    # Two entries for the same path again, but here, the other
1319
                    # entry will also be merged.  We simply inhibit the
1320
                    # 'content' conflict creation because we know OTHER will
1321
                    # create (or has already created depending on ordering) an
1322
                    # entry at the same path. This will trigger a 'duplicate'
1323
                    # conflict later.
1324
                    keep_this = True
1325
                    inhibit_content_conflict = True
1326
            if not inhibit_content_conflict:
1327
                if params.this_kind is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1328
                    self.tt.unversion_file(trans_id)
1329
                # This is a contents conflict, because none of the available
1330
                # functions could merge it.
6923.1.1 by Jelmer Vernooij
Fix regression.
1331
                file_group = self._dump_conflicts(
7143.15.2 by Jelmer Vernooij
Run autopep8.
1332
                    name, (base_path, other_path, this_path), parent_id,
1333
                    file_id, set_version=True)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1334
                self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1335
        elif hook_status == 'success':
1336
            self.tt.create_file(lines, trans_id)
1337
        elif hook_status == 'conflicted':
1338
            # XXX: perhaps the hook should be able to provide
1339
            # the BASE/THIS/OTHER files?
1340
            self.tt.create_file(lines, trans_id)
1341
            self._raw_conflicts.append(('text conflict', trans_id))
1342
            name = self.tt.final_name(trans_id)
1343
            parent_id = self.tt.final_parent(trans_id)
6923.1.1 by Jelmer Vernooij
Fix regression.
1344
            self._dump_conflicts(
1345
                name, (base_path, other_path, this_path), parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1346
        elif hook_status == 'delete':
1347
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1348
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1349
        elif hook_status == 'done':
1350
            # The hook function did whatever it needs to do directly, no
1351
            # further action needed here.
1352
            pass
1353
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1354
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1355
        if not this_path and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1356
            self.tt.version_file(file_id, trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1357
        if not keep_this:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1358
            # The merge has been performed and produced a new content, so the
1359
            # old contents should not be retained.
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1360
            self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1361
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1362
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1363
    def _default_other_winner_merge(self, merge_hook_params):
1364
        """Replace this contents with other."""
1365
        file_id = merge_hook_params.file_id
1366
        trans_id = merge_hook_params.trans_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
1367
        if merge_hook_params.other_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1368
            # OTHER changed the file
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1369
            transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1370
                self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1371
                merge_hook_params.other_path, file_id=file_id,
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1372
                filter_tree_path=self._get_filter_tree_path(file_id))
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1373
            return 'done', None
6883.10.1 by Jelmer Vernooij
Fix more tets.
1374
        elif merge_hook_params.this_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1375
            # OTHER deleted the file
1376
            return 'delete', None
1377
        else:
1378
            raise AssertionError(
1379
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1380
                % (file_id,))
1381
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1382
    def merge_contents(self, merge_hook_params):
1383
        """Fallback merge logic after user installed hooks."""
1384
        # This function is used in merge hooks as the fallback instance.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1385
        # Perhaps making this function and the functions it calls be a
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1386
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1387
        if merge_hook_params.winner == 'other':
1388
            # OTHER is a straight winner, so replace this contents with other
1389
            return self._default_other_winner_merge(merge_hook_params)
1390
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1391
            # THIS and OTHER are both files, so text merge.  Either
1392
            # BASE is a file, or both converted to files, so at least we
1393
            # have agreement that output should be a file.
1394
            try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1395
                self.text_merge(merge_hook_params.trans_id,
1396
                                merge_hook_params.paths, merge_hook_params.file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1397
            except errors.BinaryFile:
1398
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1399
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1400
        else:
1401
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1402
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1403
    def get_lines(self, tree, path):
1534.7.157 by Aaron Bentley
Added more docs
1404
        """Return the lines in a file, or an empty list."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1405
        if path is None:
1406
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1407
        try:
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1408
            kind = tree.kind(path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1409
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1410
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1411
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1412
            if kind != 'file':
1413
                return []
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1414
            return tree.get_file_lines(path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1415
6883.10.1 by Jelmer Vernooij
Fix more tets.
1416
    def text_merge(self, trans_id, paths, file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1417
        """Perform a three-way text merge on a file_id"""
1418
        # it's possible that we got here with base as a different type.
1419
        # if so, we just want two-way text conflicts.
6883.10.1 by Jelmer Vernooij
Fix more tets.
1420
        base_path, other_path, this_path = paths
7192.5.2 by Jelmer Vernooij
Fixes.
1421
        base_lines = self.get_lines(self.base_tree, base_path)
1422
        other_lines = self.get_lines(self.other_tree, other_path)
1423
        this_lines = self.get_lines(self.this_tree, this_path)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1424
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1425
                           is_cherrypick=self.cherrypick)
6973.9.1 by Jelmer Vernooij
More test fixes.
1426
        start_marker = b"!START OF MERGE CONFLICT!" + b"I HOPE THIS IS UNIQUE"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1427
        if self.show_base is True:
7045.1.1 by Jelmer Vernooij
Fix another 300 tests.
1428
            base_marker = b'|' * 7
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1429
        else:
1430
            base_marker = None
1431
1432
        def iter_merge3(retval):
1433
            retval["text_conflicts"] = False
7143.15.2 by Jelmer Vernooij
Run autopep8.
1434
            for line in m3.merge_lines(name_a=b"TREE",
1435
                                       name_b=b"MERGE-SOURCE",
1436
                                       name_base=b"BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1437
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1438
                                       base_marker=base_marker,
1439
                                       reprocess=self.reprocess):
1440
                if line.startswith(start_marker):
1441
                    retval["text_conflicts"] = True
6973.9.1 by Jelmer Vernooij
More test fixes.
1442
                    yield line.replace(start_marker, b'<' * 7)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1443
                else:
1444
                    yield line
1445
        retval = {}
1446
        merge3_iterator = iter_merge3(retval)
1447
        self.tt.create_file(merge3_iterator, trans_id)
1448
        if retval["text_conflicts"] is True:
1449
            self._raw_conflicts.append(('text conflict', trans_id))
1450
            name = self.tt.final_name(trans_id)
1451
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1452
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1453
                                              this_lines, base_lines,
1454
                                              other_lines)
1455
            file_group.append(trans_id)
1456
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1457
    def _get_filter_tree_path(self, file_id):
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1458
        if self.this_tree.supports_content_filtering():
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1459
            # We get the path from the working tree if it exists.
1460
            # That fails though when OTHER is adding a file, so
1461
            # we fall back to the other tree to find the path if
1462
            # it doesn't exist locally.
1463
            try:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1464
                return self.this_tree.id2path(file_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1465
            except errors.NoSuchId:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1466
                return self.other_tree.id2path(file_id)
1467
        # Skip the id2path lookup for older formats
1468
        return None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1469
6883.10.1 by Jelmer Vernooij
Fix more tets.
1470
    def _dump_conflicts(self, name, paths, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1471
                        base_lines=None, other_lines=None, set_version=False,
1472
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1473
        """Emit conflict files.
1474
        If this_lines, base_lines, or other_lines are omitted, they will be
1475
        determined automatically.  If set_version is true, the .OTHER, .THIS
1476
        or .BASE (in that order) will be created as versioned files.
1477
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1478
        base_path, other_path, this_path = paths
1479
        data = [('OTHER', self.other_tree, other_path, other_lines),
1480
                ('THIS', self.this_tree, this_path, this_lines)]
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1481
        if not no_base:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1482
            data.append(('BASE', self.base_tree, base_path, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1483
1484
        # We need to use the actual path in the working tree of the file here,
1485
        # ignoring the conflict suffixes
1486
        wt = self.this_tree
1487
        if wt.supports_content_filtering():
1488
            try:
1489
                filter_tree_path = wt.id2path(file_id)
1490
            except errors.NoSuchId:
1491
                # file has been deleted
1492
                filter_tree_path = None
1493
        else:
1494
            # Skip the id2path lookup for older formats
1495
            filter_tree_path = None
1496
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1497
        versioned = False
1498
        file_group = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
1499
        for suffix, tree, path, lines in data:
1500
            if path is not None:
6809.4.21 by Jelmer Vernooij
Fix long lines.
1501
                trans_id = self._conflict_file(
7143.15.2 by Jelmer Vernooij
Run autopep8.
1502
                    name, parent_id, path, tree, file_id, suffix, lines,
1503
                    filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1504
                file_group.append(trans_id)
1505
                if set_version and not versioned:
1506
                    self.tt.version_file(file_id, trans_id)
1507
                    versioned = True
1508
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1509
6809.4.21 by Jelmer Vernooij
Fix long lines.
1510
    def _conflict_file(self, name, parent_id, path, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1511
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1512
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1513
        name = name + '.' + suffix
1514
        trans_id = self.tt.create_path(name, parent_id)
6809.4.21 by Jelmer Vernooij
Fix long lines.
1515
        transform.create_from_tree(
7143.15.2 by Jelmer Vernooij
Run autopep8.
1516
            self.tt, trans_id, tree, path,
1517
            file_id=file_id, chunks=lines,
1518
            filter_tree_path=filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1519
        return trans_id
1520
6883.10.1 by Jelmer Vernooij
Fix more tets.
1521
    def merge_executable(self, paths, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1522
        """Perform a merge on the execute bit."""
7143.15.5 by Jelmer Vernooij
More PEP8 fixes.
1523
        executable = [self.executable(t, p, file_id)
1524
                      for t, p in zip([self.base_tree, self.other_tree, self.this_tree], paths)]
6883.10.1 by Jelmer Vernooij
Fix more tets.
1525
        self._merge_executable(paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1526
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1527
6883.10.1 by Jelmer Vernooij
Fix more tets.
1528
    def _merge_executable(self, paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1529
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1530
        """Perform a merge on the execute bit."""
1531
        base_executable, other_executable, this_executable = executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1532
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1533
        if file_status == "deleted":
1534
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1535
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1536
        if winner == "conflict":
7143.15.2 by Jelmer Vernooij
Run autopep8.
1537
            # There must be a None in here, if we have a conflict, but we
1538
            # need executability since file status was not deleted.
6928.1.2 by Jelmer Vernooij
Fix path specification.
1539
            if other_path is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1540
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1541
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1542
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1543
        if winner == 'this' and file_status != "modified":
1544
            return
1545
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1546
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1547
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1548
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1549
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1550
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1551
            if other_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1552
                executability = other_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1553
            elif this_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1554
                executability = this_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1555
            elif base_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1556
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1557
        if executability is not None:
1558
            trans_id = self.tt.trans_id_file_id(file_id)
1559
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1560
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1561
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1562
        """Convert all conflicts into a form that doesn't depend on trans_id"""
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1563
        content_conflict_file_ids = set()
1564
        cooked_conflicts = transform.cook_conflicts(fs_conflicts, self.tt)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1565
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1566
        for conflict in self._raw_conflicts:
1567
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1568
            if conflict_type == 'path conflict':
1569
                (trans_id, file_id,
7143.15.2 by Jelmer Vernooij
Run autopep8.
1570
                 this_parent, this_name,
1571
                 other_parent, other_name) = conflict[1:]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1572
                if this_parent is None or this_name is None:
1573
                    this_path = '<deleted>'
1574
                else:
7143.15.2 by Jelmer Vernooij
Run autopep8.
1575
                    parent_path = fp.get_path(
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1576
                        self.tt.trans_id_file_id(this_parent))
1577
                    this_path = osutils.pathjoin(parent_path, this_name)
1578
                if other_parent is None or other_name is None:
1579
                    other_path = '<deleted>'
1580
                else:
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1581
                    if other_parent == self.other_tree.get_root_id():
5050.73.9 by Vincent Ladeuil
Fix typo.
1582
                        # The tree transform doesn't know about the other root,
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1583
                        # so we special case here to avoid a NoFinalPath
1584
                        # exception
1585
                        parent_path = ''
1586
                    else:
7143.15.2 by Jelmer Vernooij
Run autopep8.
1587
                        parent_path = fp.get_path(
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1588
                            self.tt.trans_id_file_id(other_parent))
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1589
                    other_path = osutils.pathjoin(parent_path, other_name)
1590
                c = _mod_conflicts.Conflict.factory(
1591
                    'path conflict', path=this_path,
1592
                    conflict_path=other_path,
1593
                    file_id=file_id)
1594
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1595
                for trans_id in conflict[1]:
1596
                    file_id = self.tt.final_file_id(trans_id)
1597
                    if file_id is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1598
                        # Ok we found the relevant file-id
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1599
                        break
1600
                path = fp.get_path(trans_id)
1601
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1602
                    if path.endswith(suffix):
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1603
                        # Here is the raw path
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1604
                        path = path[:-len(suffix)]
1605
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1606
                c = _mod_conflicts.Conflict.factory(conflict_type,
1607
                                                    path=path, file_id=file_id)
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1608
                content_conflict_file_ids.add(file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1609
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1610
                trans_id = conflict[1]
1611
                path = fp.get_path(trans_id)
1612
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1613
                c = _mod_conflicts.Conflict.factory(conflict_type,
1614
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1615
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1616
                raise AssertionError('bad conflict type: %r' % (conflict,))
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1617
            cooked_conflicts.append(c)
5988.2.2 by Vincent Ladeuil
Make it clear that we start from an empty cooked_conflicts list.
1618
1619
        self.cooked_conflicts = []
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1620
        # We want to get rid of path conflicts when a corresponding contents
1621
        # conflict exists. This can occur when one branch deletes a file while
1622
        # the other renames *and* modifies it. In this case, the content
1623
        # conflict is enough.
1624
        for c in cooked_conflicts:
1625
            if (c.typestring == 'path conflict'
7143.15.2 by Jelmer Vernooij
Run autopep8.
1626
                    and c.file_id in content_conflict_file_ids):
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1627
                continue
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1628
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1629
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1630
1631
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1632
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1633
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1634
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1635
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1636
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1637
    history_based = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1638
    requires_file_merge_plan = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1639
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1640
    def _generate_merge_plan(self, file_id, base):
1641
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1642
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1643
1644
    def _merged_lines(self, file_id):
1645
        """Generate the merged lines.
1646
        There is no distinction between lines that are meant to contain <<<<<<<
1647
        and conflicts.
1648
        """
1649
        if self.cherrypick:
1650
            base = self.base_tree
1651
        else:
1652
            base = None
1653
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1654
        if 'merge' in debug.debug_flags:
1655
            plan = list(plan)
1656
            trans_id = self.tt.trans_id_file_id(file_id)
1657
            name = self.tt.final_name(trans_id) + '.plan'
7029.4.1 by Jelmer Vernooij
Fix a bunch of merge tests.
1658
            contents = (b'%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1659
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
7029.4.1 by Jelmer Vernooij
Fix a bunch of merge tests.
1660
        textmerge = versionedfile.PlanWeaveMerge(plan, b'<<<<<<< TREE\n',
1661
                                                 b'>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1662
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1663
        if conflicts:
1664
            base_lines = textmerge.base_from_plan()
1665
        else:
1666
            base_lines = None
1667
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1668
6883.10.1 by Jelmer Vernooij
Fix more tets.
1669
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1670
        """Perform a (weave) text merge for a given file and file-id.
1671
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1672
        and a conflict will be noted.
1673
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1674
        base_path, other_path, this_path = paths
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1675
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1676
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1677
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1678
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1679
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1680
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1681
        if base_lines is not None:
1682
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1683
            self._raw_conflicts.append(('text conflict', trans_id))
1684
            name = self.tt.final_name(trans_id)
1685
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1686
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1687
                                              no_base=False,
1688
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1689
            file_group.append(trans_id)
1690
1691
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1692
class LCAMerger(WeaveMerger):
1693
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1694
    requires_file_merge_plan = True
1695
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1696
    def _generate_merge_plan(self, file_id, base):
1697
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1698
                                                  base=base)
1699
7143.15.2 by Jelmer Vernooij
Run autopep8.
1700
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1701
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1702
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1703
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1704
    requires_file_merge_plan = False
1705
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1706
    def dump_file(self, temp_dir, name, tree, path):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1707
        out_path = osutils.pathjoin(temp_dir, name)
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1708
        with open(out_path, "wb") as out_file:
7141.7.1 by Jelmer Vernooij
Get rid of file_ids in most of Tree.
1709
            in_file = tree.get_file(path)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1710
            for line in in_file:
1711
                out_file.write(line)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1712
        return out_path
1713
6883.10.1 by Jelmer Vernooij
Fix more tets.
1714
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1715
        """Perform a diff3 merge using a specified file-id and trans-id.
1716
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1717
        will be dumped, and a will be conflict noted.
1718
        """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1719
        import breezy.patch
6883.10.1 by Jelmer Vernooij
Fix more tets.
1720
        base_path, other_path, this_path = paths
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1721
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1722
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1723
            new_file = osutils.pathjoin(temp_dir, "new")
7143.15.2 by Jelmer Vernooij
Run autopep8.
1724
            this = self.dump_file(
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1725
                temp_dir, "this", self.this_tree, this_path)
7143.15.2 by Jelmer Vernooij
Run autopep8.
1726
            base = self.dump_file(
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1727
                temp_dir, "base", self.base_tree, base_path)
7143.15.2 by Jelmer Vernooij
Run autopep8.
1728
            other = self.dump_file(
7192.5.1 by Jelmer Vernooij
Remove more file ids.
1729
                temp_dir, "other", self.other_tree, other_path)
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1730
            status = breezy.patch.diff3(new_file, this, base, other)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1731
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1732
                raise errors.BzrError("Unhandled diff3 exit code")
6861.2.1 by Jelmer Vernooij
vf Move file planning to breezy.bzr.inventorytree.
1733
            with open(new_file, 'rb') as f:
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1734
                self.tt.create_file(f, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1735
            if status == 1:
1736
                name = self.tt.final_name(trans_id)
1737
                parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1738
                self._dump_conflicts(name, paths, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1739
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1740
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1741
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1742
1743
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1744
class PathNotInTree(errors.BzrError):
1745
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1746
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1747
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1748
    def __init__(self, path, tree):
1749
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1750
1751
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1752
class MergeIntoMerger(Merger):
1753
    """Merger that understands other_tree will be merged into a subdir.
1754
1755
    This also changes the Merger api so that it uses real Branch, revision_id,
1756
    and RevisonTree objects, rather than using revision specs.
1757
    """
1758
1759
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
7143.15.2 by Jelmer Vernooij
Run autopep8.
1760
                 source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1761
        """Create a new MergeIntoMerger object.
1762
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1763
        source_subpath in other_tree will be effectively copied to
1764
        target_subdir in this_tree.
1765
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1766
        :param this_tree: The tree that we will be merging into.
1767
        :param other_branch: The Branch we will be merging from.
1768
        :param other_tree: The RevisionTree object we want to merge.
1769
        :param target_subdir: The relative path where we want to merge
1770
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1771
        :param source_subpath: The relative path specifying the subtree of
1772
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1773
        """
1774
        # It is assumed that we are merging a tree that is not in our current
1775
        # ancestry, which means we are using the "EmptyTree" as our basis.
1776
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
7143.15.2 by Jelmer Vernooij
Run autopep8.
1777
            _mod_revision.NULL_REVISION)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1778
        super(MergeIntoMerger, self).__init__(
1779
            this_branch=this_tree.branch,
1780
            this_tree=this_tree,
1781
            other_tree=other_tree,
1782
            base_tree=null_ancestor_tree,
1783
            )
1784
        self._target_subdir = target_subdir
1785
        self._source_subpath = source_subpath
1786
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1787
        if other_rev_id is None:
1788
            other_rev_id = other_tree.get_revision_id()
1789
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1790
        self.base_is_ancestor = True
1791
        self.backup_files = True
1792
        self.merge_type = Merge3Merger
1793
        self.show_base = False
1794
        self.reprocess = False
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1795
        self.interesting_files = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1796
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
7143.15.2 by Jelmer Vernooij
Run autopep8.
1797
                                                  target_subdir=self._target_subdir,
1798
                                                  source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1799
        if self._source_subpath != '':
1800
            # If this isn't a partial merge make sure the revisions will be
1801
            # present.
1802
            self._maybe_fetch(self.other_branch, self.this_branch,
7143.15.2 by Jelmer Vernooij
Run autopep8.
1803
                              self.other_basis)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1804
1805
    def set_pending(self):
1806
        if self._source_subpath != '':
1807
            return
1808
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1809
1810
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1811
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1812
    """Wrap a merge-type class to provide extra parameters.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1813
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1814
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1815
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1816
    the 'merge_type' member.  It is difficult override do_merge without
1817
    re-writing the whole thing, so instead we create a wrapper which will pass
1818
    the extra parameters.
1819
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1820
1821
    def __init__(self, merge_type, **kwargs):
1822
        self._extra_kwargs = kwargs
1823
        self._merge_type = merge_type
1824
1825
    def __call__(self, *args, **kwargs):
1826
        kwargs.update(self._extra_kwargs)
1827
        return self._merge_type(*args, **kwargs)
1828
1829
    def __getattr__(self, name):
1830
        return getattr(self._merge_type, name)
1831
1832
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1833
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1834
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1835
1836
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1837
        """Initialize the merger object.
1838
1839
        :param args: See Merge3Merger.__init__'s args.
1840
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1841
            source_subpath and target_subdir.
1842
        :keyword source_subpath: The relative path specifying the subtree of
1843
            other_tree to merge into this_tree.
1844
        :keyword target_subdir: The relative path where we want to merge
1845
            other_tree into this_tree
1846
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1847
        # All of the interesting work happens during Merge3Merger.__init__(),
1848
        # so we have have to hack in to get our extra parameters set.
1849
        self._source_subpath = kwargs.pop('source_subpath')
1850
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1851
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1852
1853
    def _compute_transform(self):
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
1854
        with ui.ui_factory.nested_progress_bar() as child_pb:
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1855
            entries = self._entries_to_incorporate()
1856
            entries = list(entries)
6874.2.9 by Jelmer Vernooij
Fix test.
1857
            for num, (entry, parent_id, relpath) in enumerate(entries):
7143.15.2 by Jelmer Vernooij
Run autopep8.
1858
                child_pb.update(gettext('Preparing file merge'),
1859
                                num, len(entries))
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1860
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
6874.2.9 by Jelmer Vernooij
Fix test.
1861
                path = osutils.pathjoin(self._source_subpath, relpath)
6874.2.8 by Jelmer Vernooij
Fix test.
1862
                trans_id = transform.new_by_entry(path, self.tt, entry,
7143.15.2 by Jelmer Vernooij
Run autopep8.
1863
                                                  parent_trans_id, self.other_tree)
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1864
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1865
1866
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1867
        """Yields pairs of (inventory_entry, new_parent)."""
6405.2.10 by Jelmer Vernooij
Fix more tests.
1868
        other_inv = self.other_tree.root_inventory
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1869
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1870
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1871
            # XXX: The error would be clearer if it gave the URL of the source
1872
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1873
            raise PathNotInTree(self._source_subpath, "Source tree")
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
1874
        subdir = other_inv.get_entry(subdir_id)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1875
        parent_in_target = osutils.dirname(self._target_subdir)
6405.2.10 by Jelmer Vernooij
Fix more tests.
1876
        target_id = self.this_tree.path2id(parent_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1877
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1878
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1879
        name_in_target = osutils.basename(self._target_subdir)
1880
        merge_into_root = subdir.copy()
1881
        merge_into_root.name = name_in_target
6405.2.10 by Jelmer Vernooij
Fix more tests.
1882
        if self.this_tree.has_id(merge_into_root.file_id):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1883
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1884
            # This can happen fairly easily if the directory we are
1885
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1886
            # their root_id.  Users will expect this to Just Work, so we
1887
            # change the file-id here.
1888
            # Non-root file-ids could potentially conflict too.  That's really
1889
            # an edge case, so we don't do anything special for those.  We let
1890
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1891
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1892
        yield (merge_into_root, target_id, '')
5246.2.10 by Andrew Bennetts
Add more tests.
1893
        if subdir.kind != 'directory':
1894
            # No children, so we are done.
1895
            return
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1896
        for path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1897
            parent_id = entry.parent_id
1898
            if parent_id == subdir.file_id:
1899
                # The root's parent ID has changed, so make sure children of
1900
                # the root refer to the new ID.
1901
                parent_id = merge_into_root.file_id
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1902
            yield (entry, parent_id, path)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1903
1904
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1905
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1906
                backup_files=False,
1907
                merge_type=Merge3Merger,
1908
                show_base=False,
1909
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1910
                other_rev_id=None,
1911
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1912
                this_tree=None,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
1913
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1914
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1915
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1916
    Typical use is probably::
1917
1918
        merge_inner(branch, branch.get_revision_tree(other_revision),
1919
                    branch.get_revision_tree(base_revision))
1920
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1921
    if this_tree is None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1922
        raise errors.BzrError("breezy.merge.merge_inner requires a this_tree "
5993.2.1 by Jelmer Vernooij
Add test for rootless tree merge.
1923
                              "parameter")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1924
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
6719.1.2 by Jelmer Vernooij
Fix some tests.
1925
                    change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1926
    merger.backup_files = backup_files
1927
    merger.merge_type = merge_type
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1928
    merger.ignore_zero = ignore_zero
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1929
    merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1930
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1931
    merger.reprocess = reprocess
1932
    merger.other_rev_id = other_rev_id
1933
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1934
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1935
    if get_revision_id is None:
1936
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1937
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1938
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1939
    return merger.do_merge()
1940
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1941
1942
merge_type_registry = registry.Registry()
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1943
merge_type_registry.register('diff3', Diff3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1944
                             "Merge using external diff3.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1945
merge_type_registry.register('lca', LCAMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1946
                             "LCA-newness merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1947
merge_type_registry.register('merge3', Merge3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1948
                             "Native diff3-style merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1949
merge_type_registry.register('weave', WeaveMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1950
                             "Weave-based merge.")
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1951
1952
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1953
def get_merge_type_registry():
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1954
    """Merge type registry was previously in breezy.option
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1955
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1956
    This method provides a backwards compatible way to retrieve it.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1957
    """
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1958
    return merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1959
1960
1961
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1962
    def status_a(revision, text):
1963
        if revision in ancestors_b:
1964
            return 'killed-b', text
1965
        else:
1966
            return 'new-a', text
1967
1968
    def status_b(revision, text):
1969
        if revision in ancestors_a:
1970
            return 'killed-a', text
1971
        else:
1972
            return 'new-b', text
1973
1974
    plain_a = [t for (a, t) in annotated_a]
1975
    plain_b = [t for (a, t) in annotated_b]
1976
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1977
    blocks = matcher.get_matching_blocks()
1978
    a_cur = 0
1979
    b_cur = 0
1980
    for ai, bi, l in blocks:
1981
        # process all mismatched sections
1982
        # (last mismatched section is handled because blocks always
1983
        # includes a 0-length last block)
1984
        for revision, text in annotated_a[a_cur:ai]:
1985
            yield status_a(revision, text)
1986
        for revision, text in annotated_b[b_cur:bi]:
1987
            yield status_b(revision, text)
1988
        # and now the matched section
1989
        a_cur = ai + l
1990
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
1991
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
1992
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1993
1994
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1995
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1996
3350.6.10 by Martin Pool
VersionedFiles review cleanups
1997
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
1998
        """Contructor.
1999
2000
        :param a_rev: Revision-id of one revision to merge
2001
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2002
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2003
        :param key_prefix: A prefix for accessing keys in vf, typically
2004
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2005
        """
2006
        self.a_rev = a_rev
2007
        self.b_rev = b_rev
2008
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2009
        self._last_lines = None
2010
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2011
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2012
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2013
        self._precache_tip_lines()
2014
2015
    def _precache_tip_lines(self):
2016
        lines = self.get_lines([self.a_rev, self.b_rev])
2017
        self.lines_a = lines[self.a_rev]
2018
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2019
2020
    def get_lines(self, revisions):
2021
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2022
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2023
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2024
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2025
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2026
        result = {}
2027
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2028
            if record.storage_kind == 'absent':
2029
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2030
            result[record.key[-1]] = osutils.chunks_to_lines(
2031
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2032
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2033
2034
    def plan_merge(self):
2035
        """Generate a 'plan' for merging the two revisions.
2036
2037
        This involves comparing their texts and determining the cause of
2038
        differences.  If text A has a line and text B does not, then either the
2039
        line was added to text A, or it was deleted from B.  Once the causes
2040
        are combined, they are written out in the format described in
2041
        VersionedFile.plan_merge
2042
        """
2043
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2044
        unique_a, unique_b = self._unique_lines(blocks)
2045
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2046
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2047
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2048
2049
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2050
        last_i = 0
2051
        last_j = 0
2052
        for i, j, n in blocks:
2053
            for a_index in range(last_i, i):
2054
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2055
                    if a_index in killed_b:
2056
                        yield 'conflicted-a', self.lines_a[a_index]
2057
                    else:
2058
                        yield 'new-a', self.lines_a[a_index]
2059
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2060
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2061
            for b_index in range(last_j, j):
2062
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2063
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2064
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2065
                    else:
2066
                        yield 'new-b', self.lines_b[b_index]
2067
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2068
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2069
            # handle common lines
7143.15.2 by Jelmer Vernooij
Run autopep8.
2070
            for a_index in range(i, i + n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2071
                yield 'unchanged', self.lines_a[a_index]
7143.15.2 by Jelmer Vernooij
Run autopep8.
2072
            last_i = i + n
2073
            last_j = j + n
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2074
2075
    def _get_matching_blocks(self, left_revision, right_revision):
2076
        """Return a description of which sections of two revisions match.
2077
2078
        See SequenceMatcher.get_matching_blocks
2079
        """
3144.3.7 by Aaron Bentley
Update from review
2080
        cached = self._cached_matching_blocks.get((left_revision,
2081
                                                   right_revision))
2082
        if cached is not None:
2083
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2084
        if self._last_lines_revision_id == left_revision:
2085
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2086
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2087
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2088
            lines = self.get_lines([left_revision, right_revision])
2089
            left_lines = lines[left_revision]
2090
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2091
        self._last_lines = right_lines
2092
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2093
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2094
                                                       right_lines)
2095
        return matcher.get_matching_blocks()
2096
2097
    def _unique_lines(self, matching_blocks):
2098
        """Analyse matching_blocks to determine which lines are unique
2099
2100
        :return: a tuple of (unique_left, unique_right), where the values are
2101
            sets of line numbers of unique lines.
2102
        """
2103
        last_i = 0
2104
        last_j = 0
2105
        unique_left = []
2106
        unique_right = []
2107
        for i, j, n in matching_blocks:
2108
            unique_left.extend(range(last_i, i))
2109
            unique_right.extend(range(last_j, j))
2110
            last_i = i + n
2111
            last_j = j + n
2112
        return unique_left, unique_right
2113
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2114
    @staticmethod
2115
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2116
        """Remove changes from new_plan that came from old_plan.
2117
2118
        It is assumed that the difference between the old_plan and new_plan
2119
        is their choice of 'b' text.
2120
2121
        All lines from new_plan that differ from old_plan are emitted
2122
        verbatim.  All lines from new_plan that match old_plan but are
2123
        not about the 'b' revision are emitted verbatim.
2124
2125
        Lines that match and are about the 'b' revision are the lines we
2126
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2127
        is skipped entirely.
2128
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2129
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2130
                                                       new_plan)
2131
        last_j = 0
2132
        for i, j, n in matcher.get_matching_blocks():
2133
            for jj in range(last_j, j):
2134
                yield new_plan[jj]
7143.15.2 by Jelmer Vernooij
Run autopep8.
2135
            for jj in range(j, j + n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2136
                plan_line = new_plan[jj]
2137
                if plan_line[0] == 'new-b':
2138
                    pass
2139
                elif plan_line[0] == 'killed-b':
2140
                    yield 'unchanged', plan_line[1]
2141
                else:
2142
                    yield plan_line
2143
            last_j = j + n
2144
2145
2146
class _PlanMerge(_PlanMergeBase):
2147
    """Plan an annotate merge using on-the-fly annotation"""
2148
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2149
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2150
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2151
        self.a_key = self._key_prefix + (self.a_rev,)
2152
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2153
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2154
        heads = self.graph.heads((self.a_key, self.b_key))
2155
        if len(heads) == 1:
2156
            # one side dominates, so we can just return its values, yay for
2157
            # per-file graphs
2158
            # Ideally we would know that before we get this far
2159
            self._head_key = heads.pop()
2160
            if self._head_key == self.a_key:
2161
                other = b_rev
2162
            else:
2163
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2164
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2165
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2166
            self._weave = None
2167
        else:
2168
            self._head_key = None
2169
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2170
2171
    def _precache_tip_lines(self):
2172
        # Turn this into a no-op, because we will do this later
2173
        pass
2174
2175
    def _find_recursive_lcas(self):
2176
        """Find all the ancestors back to a unique lca"""
2177
        cur_ancestors = (self.a_key, self.b_key)
2178
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2179
        # rather than a key tuple. We will just map that directly to no common
2180
        # ancestors.
2181
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2182
        while True:
2183
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2184
            # Map a plain NULL_REVISION to a simple no-ancestors
6619.3.12 by Jelmer Vernooij
Use 2to3 set_literal fixer.
2185
            if next_lcas == {_mod_revision.NULL_REVISION}:
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2186
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2187
            # Order the lca's based on when they were merged into the tip
2188
            # While the actual merge portion of weave merge uses a set() of
2189
            # active revisions, the order of insertion *does* effect the
2190
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2191
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2192
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2193
                                                                    next_lcas))
2194
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2195
            if len(next_lcas) == 0:
2196
                break
2197
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2198
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2199
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2200
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2201
                # More than 2 lca's, fall back to grabbing all nodes between
2202
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2203
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2204
                             ' %s, %s\n=> %s',
2205
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2206
                cur_lcas = next_lcas
2207
                while len(cur_lcas) > 1:
2208
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2209
                if len(cur_lcas) == 0:
2210
                    # No common base to find, use the full ancestry
2211
                    unique_lca = None
2212
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2213
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2214
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2215
                        # find_lca will return a plain 'NULL_REVISION' rather
2216
                        # than a key tuple when there is no common ancestor, we
2217
                        # prefer to just use None, because it doesn't confuse
2218
                        # _get_interesting_texts()
2219
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2220
                parent_map.update(self._find_unique_parents(next_lcas,
2221
                                                            unique_lca))
2222
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2223
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2224
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2225
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2226
    def _find_unique_parents(self, tip_keys, base_key):
2227
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2228
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2229
        :param tip_keys: Nodes that are interesting
2230
        :param base_key: Cull all ancestors of this node
2231
        :return: The parent map for all revisions between tip_keys and
2232
            base_key. base_key will be included. References to nodes outside of
2233
            the ancestor set will also be removed.
2234
        """
2235
        # TODO: this would be simpler if find_unique_ancestors took a list
2236
        #       instead of a single tip, internally it supports it, but it
2237
        #       isn't a "backwards compatible" api change.
2238
        if base_key is None:
2239
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2240
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2241
            # thus confuses things like _get_interesting_texts, and our logic
2242
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2243
            if _mod_revision.NULL_REVISION in parent_map:
2244
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2245
        else:
2246
            interesting = set()
2247
            for tip in tip_keys:
2248
                interesting.update(
2249
                    self.graph.find_unique_ancestors(tip, [base_key]))
2250
            parent_map = self.graph.get_parent_map(interesting)
2251
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2252
        culled_parent_map, child_map, tails = self._remove_external_references(
2253
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2254
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2255
        if base_key is not None:
2256
            tails.remove(base_key)
2257
            self._prune_tails(culled_parent_map, child_map, tails)
2258
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2259
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2260
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2261
2262
    @staticmethod
2263
    def _remove_external_references(parent_map):
2264
        """Remove references that go outside of the parent map.
2265
2266
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2267
        :return: (filtered_parent_map, child_map, tails)
2268
            filtered_parent_map is parent_map without external references
2269
            child_map is the {parent_key: [child_keys]} mapping
2270
            tails is a list of nodes that do not have any parents in the map
2271
        """
2272
        # TODO: The basic effect of this function seems more generic than
2273
        #       _PlanMerge. But the specific details of building a child_map,
2274
        #       and computing tails seems very specific to _PlanMerge.
2275
        #       Still, should this be in Graph land?
2276
        filtered_parent_map = {}
2277
        child_map = {}
2278
        tails = []
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
2279
        for key, parent_keys in viewitems(parent_map):
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2280
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2281
            if not culled_parent_keys:
2282
                tails.append(key)
2283
            for parent_key in culled_parent_keys:
2284
                child_map.setdefault(parent_key, []).append(key)
2285
            # TODO: Do we want to do this, it adds overhead for every node,
2286
            #       just to say that the node has no children
2287
            child_map.setdefault(key, [])
2288
            filtered_parent_map[key] = culled_parent_keys
2289
        return filtered_parent_map, child_map, tails
2290
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2291
    @staticmethod
2292
    def _prune_tails(parent_map, child_map, tails_to_remove):
2293
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2294
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2295
        This will remove the supplied revisions until no more children have 0
2296
        parents.
2297
2298
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2299
            be modified in place.
2300
        :param tails_to_remove: A list of tips that should be removed,
2301
            this list will be consumed
2302
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2303
            this dict will be modified
2304
        :return: None, parent_map will be modified in place.
2305
        """
2306
        while tails_to_remove:
2307
            next = tails_to_remove.pop()
2308
            parent_map.pop(next)
2309
            children = child_map.pop(next)
2310
            for child in children:
2311
                child_parents = parent_map[child]
2312
                child_parents.remove(next)
2313
                if len(child_parents) == 0:
2314
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2315
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2316
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2317
        """Return a dict of texts we are interested in.
2318
2319
        Note that the input is in key tuples, but the output is in plain
2320
        revision ids.
2321
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2322
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2323
        :return: A dict of {'revision_id':lines} as returned by
2324
            _PlanMergeBase.get_lines()
2325
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2326
        all_revision_keys = set(parent_map)
2327
        all_revision_keys.add(self.a_key)
2328
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2329
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2330
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2331
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2332
        return all_texts
2333
2334
    def _build_weave(self):
6670.4.3 by Jelmer Vernooij
Fix more imports.
2335
        from .bzr import weave
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2336
        self._weave = weave.Weave(weave_name='in_memory_weave',
2337
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2338
        parent_map = self._find_recursive_lcas()
2339
2340
        all_texts = self._get_interesting_texts(parent_map)
2341
2342
        # Note: Unfortunately, the order given by topo_sort will effect the
2343
        # ordering resolution in the output. Specifically, if you add A then B,
2344
        # then in the output text A lines will show up before B lines. And, of
2345
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2346
        # So we use merge_sort, and add a fake node on the tip.
2347
        # This ensures that left-hand parents will always be inserted into the
2348
        # weave before right-hand parents.
2349
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2350
        parent_map[tip_key] = (self.a_key, self.b_key)
2351
2352
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2353
                                                                  tip_key)):
2354
            if key == tip_key:
2355
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2356
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2357
            parent_keys = parent_map[key]
2358
            revision_id = key[-1]
2359
            parent_ids = [k[-1] for k in parent_keys]
2360
            self._weave.add_lines(revision_id, parent_ids,
2361
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2362
2363
    def plan_merge(self):
2364
        """Generate a 'plan' for merging the two revisions.
2365
2366
        This involves comparing their texts and determining the cause of
2367
        differences.  If text A has a line and text B does not, then either the
2368
        line was added to text A, or it was deleted from B.  Once the causes
2369
        are combined, they are written out in the format described in
2370
        VersionedFile.plan_merge
2371
        """
7143.15.2 by Jelmer Vernooij
Run autopep8.
2372
        if self._head_key is not None:  # There was a single head
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2373
            if self._head_key == self.a_key:
2374
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2375
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2376
                if self._head_key != self.b_key:
2377
                    raise AssertionError('There was an invalid head: %s != %s'
2378
                                         % (self.b_key, self._head_key))
2379
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2380
            head_rev = self._head_key[-1]
2381
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2382
            return ((plan, line) for line in lines)
2383
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2384
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2385
2386
class _PlanLCAMerge(_PlanMergeBase):
2387
    """
3144.3.7 by Aaron Bentley
Update from review
2388
    This merge algorithm differs from _PlanMerge in that:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2389
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2390
    1. comparisons are done against LCAs only
2391
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2392
       another are marked as conflicts, by emitting the line as conflicted-a
2393
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2394
2395
    This is faster, and hopefully produces more useful output.
2396
    """
2397
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2398
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2399
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2400
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2401
        self.lcas = set()
2402
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2403
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2404
                self.lcas.add(lca)
2405
            else:
2406
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2407
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2408
            if _mod_revision.is_null(lca):
2409
                lca_lines = []
2410
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2411
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2412
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2413
                                                           lca_lines)
2414
            blocks = list(matcher.get_matching_blocks())
2415
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2416
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2417
                                                           lca_lines)
2418
            blocks = list(matcher.get_matching_blocks())
2419
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2420
3144.3.7 by Aaron Bentley
Update from review
2421
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2422
        """Determines the status unique lines versus all lcas.
2423
2424
        Basically, determines why the line is unique to this revision.
2425
2426
        A line may be determined new, killed, or both.
2427
3144.3.7 by Aaron Bentley
Update from review
2428
        If a line is determined new, that means it was not present in at least
2429
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2430
2431
        If a line is determined killed, that means the line was present in
2432
        at least one LCA.
2433
2434
        If a line is killed and new, this indicates that the two merge
2435
        revisions contain differing conflict resolutions.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2436
3144.3.7 by Aaron Bentley
Update from review
2437
        :param revision_id: The id of the revision in which the lines are
2438
            unique
2439
        :param unique_line_numbers: The line numbers of unique lines.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2440
        :return: a tuple of (new_this, killed_other)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2441
        """
2442
        new = set()
2443
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2444
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2445
        for lca in self.lcas:
2446
            blocks = self._get_matching_blocks(revision_id, lca)
2447
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2448
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2449
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2450
        return new, killed