/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
6379.6.1 by Jelmer Vernooij
Import absolute_import in a few places.
17
from __future__ import absolute_import
18
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
19
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
20
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
21
from .lazy_import import lazy_import
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
22
lazy_import(globals(), """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
23
from breezy import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
25
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
26
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
27
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
28
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
29
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
30
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
31
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
32
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
33
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
34
    textfile,
35
    trace,
36
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
37
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
38
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
39
    ui,
6670.4.3 by Jelmer Vernooij
Fix more imports.
40
    workingtree,
41
    )
42
from breezy.bzr import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
43
    versionedfile,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
44
    )
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
45
from breezy.i18n import gettext
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
46
""")
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
47
from . import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
48
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
49
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
50
    hooks,
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
51
    registry,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
52
    )
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
53
from .sixish import (
6973.6.2 by Jelmer Vernooij
Fix more tests.
54
    text_type,
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
55
    viewitems,
56
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
57
# TODO: Report back as changes are merged in
58
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
59
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
60
def transform_tree(from_tree, to_tree, interesting_files=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
61
    from_tree.lock_tree_write()
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
62
    operation = cleanup.OperationWithCleanups(merge_inner)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
63
    operation.add_cleanup(from_tree.unlock)
64
    operation.run_simple(from_tree.branch, to_tree, from_tree,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
65
        ignore_zero=True, this_tree=from_tree,
66
        interesting_files=interesting_files)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
67
1457.1.12 by Robert Collins
Update comment to reflect author.
68
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
69
class MergeHooks(hooks.Hooks):
70
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
71
    def __init__(self):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
72
        hooks.Hooks.__init__(self, "breezy.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
73
        self.add_hook('merge_file_content',
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
74
            "Called with a breezy.merge.Merger object to create a per file "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
75
            "merge object when starting a merge. "
76
            "Should return either None or a subclass of "
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
77
            "``breezy.merge.AbstractPerFileMerger``. "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
78
            "Such objects will then be called per file "
79
            "that needs to be merged (including when one "
80
            "side has deleted the file and the other has changed it). "
81
            "See the AbstractPerFileMerger API docs for details on how it is "
82
            "used by merge.",
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
83
            (2, 1))
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
84
        self.add_hook('pre_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
85
            'Called before a merge. '
86
            'Receives a Merger object as the single argument.',
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
87
            (2, 5))
88
        self.add_hook('post_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
89
            'Called after a merge. '
90
            'Receives a Merger object as the single argument. '
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
91
            'The return value is ignored.',
92
            (2, 5))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
93
94
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
95
class AbstractPerFileMerger(object):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
96
    """PerFileMerger objects are used by plugins extending merge for breezy.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
97
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
98
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
99
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
100
    :ivar merger: The Merge3Merger performing the merge.
101
    """
102
103
    def __init__(self, merger):
104
        """Create a PerFileMerger for use with merger."""
105
        self.merger = merger
106
107
    def merge_contents(self, merge_params):
108
        """Attempt to merge the contents of a single file.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
109
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
110
        :param merge_params: A breezy.merge.MergeFileHookParams
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
111
        :return: A tuple of (status, chunks), where status is one of
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
112
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
113
            is 'success' or 'conflicted', then chunks should be an iterable of
114
            strings for the new file contents.
115
        """
116
        return ('not applicable', None)
117
118
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
119
class PerFileMerger(AbstractPerFileMerger):
120
    """Merge individual files when self.file_matches returns True.
121
122
    This class is intended to be subclassed.  The file_matches and
123
    merge_matching methods should be overridden with concrete implementations.
124
    """
125
126
    def file_matches(self, params):
127
        """Return True if merge_matching should be called on this file.
128
129
        Only called with merges of plain files with no clear winner.
130
131
        Subclasses must override this.
132
        """
133
        raise NotImplementedError(self.file_matches)
134
135
    def merge_contents(self, params):
136
        """Merge the contents of a single file."""
137
        # Check whether this custom merge logic should be used.
138
        if (
139
            # OTHER is a straight winner, rely on default merge.
140
            params.winner == 'other' or
141
            # THIS and OTHER aren't both files.
142
            not params.is_file_merge() or
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
143
            # The filename doesn't match
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
144
            not self.file_matches(params)):
145
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
146
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
147
148
    def merge_matching(self, params):
149
        """Merge the contents of a single file that has matched the criteria
150
        in PerFileMerger.merge_contents (is a conflict, is a file,
151
        self.file_matches is True).
152
153
        Subclasses must override this.
154
        """
155
        raise NotImplementedError(self.merge_matching)
156
157
158
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
159
    """Merge individual files when configured via a .conf file.
160
161
    This is a base class for concrete custom file merging logic. Concrete
162
    classes should implement ``merge_text``.
163
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
164
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
165
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
166
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
167
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
168
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
169
        details. <name_prefix>_merge_files describes the files targeted by the
170
        hook for example.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
171
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
172
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
173
        is present.
174
    """
175
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
176
    name_prefix = None
177
    default_files = None
178
179
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
180
        super(ConfigurableFileMerger, self).__init__(merger)
181
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
182
        self.default_files = self.__class__.default_files or []
183
        self.name_prefix = self.__class__.name_prefix
184
        if self.name_prefix is None:
185
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
186
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
187
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
188
        """Check whether the file should call the merge hook.
189
190
        <name_prefix>_merge_files configuration variable is a list of files
191
        that should use the hook.
192
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
193
        affected_files = self.affected_files
194
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
195
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
196
            # Until bzr provides a better policy for caching the config, we
197
            # just add the part we're interested in to the params to avoid
6740.1.1 by Jelmer Vernooij
Rename bazaar.conf to breezy.conf.
198
            # reading the config files repeatedly (breezy.conf, location.conf,
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
199
            # branch.conf).
200
            config_key = self.name_prefix + '_merge_files'
201
            affected_files = config.get_user_option_as_list(config_key)
202
            if affected_files is None:
203
                # If nothing was specified in the config, use the default.
204
                affected_files = self.default_files
205
            self.affected_files = affected_files
206
        if affected_files:
6883.10.1 by Jelmer Vernooij
Fix more tets.
207
            filepath = params.this_path
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
208
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
209
                return True
210
        return False
211
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
212
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
213
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
214
215
    def merge_text(self, params):
216
        """Merge the byte contents of a single file.
217
218
        This is called after checking that the merge should be performed in
219
        merge_contents, and it should behave as per
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
220
        ``breezy.merge.AbstractPerFileMerger.merge_contents``.
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
221
        """
222
        raise NotImplementedError(self.merge_text)
223
224
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
225
class MergeFileHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
226
    """Object holding parameters passed to merge_file_content hooks.
227
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
228
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
229
230
    :ivar file_id: the file ID of the file being merged
6883.10.1 by Jelmer Vernooij
Fix more tets.
231
    :ivar base_path: Path in base tree
232
    :ivar other_path: Path in other tree
233
    :ivar this_path: Path in this tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
234
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
235
    :ivar this_kind: kind of file_id in 'this' tree
236
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
237
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
238
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
239
6883.10.1 by Jelmer Vernooij
Fix more tets.
240
    def __init__(self, merger, file_id, paths, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
241
            winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
242
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
243
        self.file_id = file_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
244
        self.paths = paths
245
        self.base_path, self.other_path, self.this_path = paths
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
246
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
247
        self.this_kind = this_kind
248
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
249
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
250
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
251
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
252
        """True if this_kind and other_kind are both 'file'."""
253
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
254
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
255
    @decorators.cachedproperty
256
    def base_lines(self):
257
        """The lines of the 'base' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
258
        return self._merger.get_lines(self._merger.base_tree, self.base_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
259
260
    @decorators.cachedproperty
261
    def this_lines(self):
262
        """The lines of the 'this' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
263
        return self._merger.get_lines(self._merger.this_tree, self.this_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
264
265
    @decorators.cachedproperty
266
    def other_lines(self):
267
        """The lines of the 'other' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
268
        return self._merger.get_lines(self._merger.other_tree, self.other_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
269
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
270
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
271
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
272
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
273
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
274
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
275
    def __init__(self, this_branch, other_tree=None, base_tree=None,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
276
                 this_tree=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
277
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
278
        object.__init__(self)
279
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
280
        self.this_basis = _mod_revision.ensure_null(
281
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
282
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
283
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
284
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
285
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
286
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
287
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
288
        self.base_tree = base_tree
289
        self.ignore_zero = False
290
        self.backup_files = False
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
291
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
292
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
293
        self.reprocess = False
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
294
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
295
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
296
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
297
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
298
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
299
        self._base_is_ancestor = None
300
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
301
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
302
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
303
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
304
    def cache_trees_with_revision_ids(self, trees):
305
        """Cache any tree in trees if it has a revision_id."""
306
        for maybe_tree in trees:
307
            if maybe_tree is None:
308
                continue
309
            try:
310
                rev_id = maybe_tree.get_revision_id()
311
            except AttributeError:
312
                continue
313
            self._cached_trees[rev_id] = maybe_tree
314
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
315
    @property
316
    def revision_graph(self):
317
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
318
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
319
        return self._revision_graph
320
321
    def _set_base_is_ancestor(self, value):
322
        self._base_is_ancestor = value
323
324
    def _get_base_is_ancestor(self):
325
        if self._base_is_ancestor is None:
326
            self._base_is_ancestor = self.revision_graph.is_ancestor(
327
                self.base_rev_id, self.this_basis)
328
        return self._base_is_ancestor
329
330
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
331
332
    def _set_base_is_other_ancestor(self, value):
333
        self._base_is_other_ancestor = value
334
335
    def _get_base_is_other_ancestor(self):
336
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
337
            if self.other_basis is None:
338
                return True
339
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
340
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
341
        return self._base_is_other_ancestor
342
343
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
344
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
345
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
346
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
347
    def from_uncommitted(tree, other_tree, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
348
        """Return a Merger for uncommitted changes in other_tree.
349
350
        :param tree: The tree to merge into
351
        :param other_tree: The tree to get uncommitted changes from
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
352
        :param base_tree: The basis to use for the merge.  If unspecified,
353
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
354
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
355
        if base_tree is None:
356
            base_tree = other_tree.basis_tree()
6719.1.2 by Jelmer Vernooij
Fix some tests.
357
        merger = Merger(tree.branch, other_tree, base_tree, tree)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
358
        merger.base_rev_id = merger.base_tree.get_revision_id()
359
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
360
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
361
        return merger
362
363
    @classmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
364
    def from_mergeable(klass, tree, mergeable):
1551.15.74 by Aaron Bentley
Textual updates from review
365
        """Return a Merger for a bundle or merge directive.
366
367
        :param tree: The tree to merge changes into
368
        :param mergeable: A merge directive or bundle
369
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
370
        mergeable.install_revisions(tree.branch.repository)
371
        base_revision_id, other_revision_id, verified =\
372
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
373
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
374
        if base_revision_id is not None:
375
            if (base_revision_id != _mod_revision.NULL_REVISION and
376
                revision_graph.is_ancestor(
377
                base_revision_id, tree.branch.last_revision())):
378
                base_revision_id = None
379
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
380
                trace.warning('Performing cherrypick')
6719.1.2 by Jelmer Vernooij
Fix some tests.
381
        merger = klass.from_revision_ids(tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
382
                                         base_revision_id, revision_graph=
383
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
384
        return merger, verified
385
386
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
387
    def from_revision_ids(tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
388
                          base_branch=None, revision_graph=None,
389
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
390
        """Return a Merger for revision-ids.
391
392
        :param tree: The tree to merge changes into
393
        :param other: The revision-id to use as OTHER
394
        :param base: The revision-id to use as BASE.  If not specified, will
395
            be auto-selected.
396
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
397
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
398
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
399
            not supplied, other_branch or tree.branch will be used.
400
        :param revision_graph: If you have a revision_graph precomputed, pass
401
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
402
        :param tree_branch: The branch associated with tree.  If not supplied,
403
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
404
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
405
        if tree_branch is None:
406
            tree_branch = tree.branch
6719.1.2 by Jelmer Vernooij
Fix some tests.
407
        merger = Merger(tree_branch, this_tree=tree,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
408
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
409
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
410
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
411
        merger.set_other_revision(other, other_branch)
412
        if base is None:
413
            merger.find_base()
414
        else:
415
            if base_branch is None:
416
                base_branch = other_branch
417
            merger.set_base_revision(base, base_branch)
418
        return merger
419
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
420
    def revision_tree(self, revision_id, branch=None):
421
        if revision_id not in self._cached_trees:
422
            if branch is None:
423
                branch = self.this_branch
424
            try:
425
                tree = self.this_tree.revision_tree(revision_id)
426
            except errors.NoSuchRevisionInTree:
427
                tree = branch.repository.revision_tree(revision_id)
428
            self._cached_trees[revision_id] = tree
429
        return self._cached_trees[revision_id]
430
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
431
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
432
        location, revno = treespec
433
        if revno is None:
434
            tree = workingtree.WorkingTree.open_containing(location)[0]
435
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
436
        branch = _mod_branch.Branch.open_containing(
437
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
438
        if revno == -1:
439
            revision_id = branch.last_revision()
440
        else:
441
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
442
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
443
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
444
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
445
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
446
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
447
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
448
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
449
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
450
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
451
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
452
        self._add_parent()
453
454
    def _add_parent(self):
455
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
456
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
457
        operation = cleanup.OperationWithCleanups(
458
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
459
        for revision_id in new_parents:
460
            try:
461
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
462
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
463
                tree = None
464
            else:
465
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
466
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
467
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
468
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
469
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
470
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
471
        """Set the revision and tree to merge from.
472
473
        This sets the other_tree, other_rev_id, other_basis attributes.
474
475
        :param other_revision: The [path, revision] list to merge from.
476
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
477
        self.other_branch, self.other_tree = self._get_tree(other_revision,
478
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
479
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
480
            self.other_rev_id = _mod_revision.ensure_null(
481
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
482
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
483
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
484
            self.other_basis = self.other_rev_id
485
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
486
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
487
            self.other_basis = self.other_rev_id
488
        else:
489
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
490
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
491
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
492
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
493
        if self.other_rev_id is not None:
494
            self._cached_trees[self.other_rev_id] = self.other_tree
6388.1.2 by Jelmer Vernooij
Fix formatting.
495
        self._maybe_fetch(self.other_branch, self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
496
2100.3.29 by Aaron Bentley
Get merge working initially
497
    def set_other_revision(self, revision_id, other_branch):
498
        """Set 'other' based on a branch and revision id
499
500
        :param revision_id: The revision to use for a tree
501
        :param other_branch: The branch containing this tree
502
        """
503
        self.other_rev_id = revision_id
504
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
505
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
506
        self.other_tree = self.revision_tree(revision_id)
507
        self.other_basis = revision_id
508
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
509
    def set_base_revision(self, revision_id, branch):
510
        """Set 'base' based on a branch and revision id
511
512
        :param revision_id: The revision to use for a tree
513
        :param branch: The branch containing this tree
514
        """
515
        self.base_rev_id = revision_id
516
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
517
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
518
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
519
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
520
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
521
        if not source.repository.has_same_location(target.repository):
5741.1.9 by Jelmer Vernooij
Remove fetch_tags argument.
522
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
523
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
524
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
525
        revisions = [_mod_revision.ensure_null(self.this_basis),
526
                     _mod_revision.ensure_null(self.other_basis)]
527
        if _mod_revision.NULL_REVISION in revisions:
528
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
529
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
530
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
531
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
532
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
533
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
534
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
535
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
536
            elif len(lcas) == 1:
537
                self.base_rev_id = list(lcas)[0]
538
            else: # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
539
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
540
                if len(lcas) > 2:
541
                    # find_unique_lca can only handle 2 nodes, so we have to
542
                    # start back at the beginning. It is a shame to traverse
543
                    # the graph again, but better than re-implementing
544
                    # find_unique_lca.
545
                    self.base_rev_id = self.revision_graph.find_unique_lca(
546
                                            revisions[0], revisions[1])
547
                else:
548
                    self.base_rev_id = self.revision_graph.find_unique_lca(
549
                                            *lcas)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
550
                sorted_lca_keys = self.revision_graph.find_merge_order(
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
551
                    revisions[0], lcas)
552
                if self.base_rev_id == _mod_revision.NULL_REVISION:
553
                    self.base_rev_id = sorted_lca_keys[0]
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
554
4721.3.1 by Vincent Ladeuil
Cleanup imports.
555
            if self.base_rev_id == _mod_revision.NULL_REVISION:
556
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
557
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
558
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
559
                              ' help criss-cross.')
560
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
561
                if self.base_rev_id in lcas:
562
                    trace.mutter('Unable to find unique lca. '
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
563
                                 'Fallback %r as best option.'
564
                                 % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
565
                interesting_revision_ids = set(lcas)
566
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
567
                interesting_trees = dict((t.get_revision_id(), t)
568
                    for t in self.this_branch.repository.revision_trees(
569
                        interesting_revision_ids))
570
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
571
                if self.base_rev_id in lcas:
572
                    self.base_tree = interesting_trees[self.base_rev_id]
573
                else:
574
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
575
                self._lca_trees = [interesting_trees[key]
576
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
577
            else:
578
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
579
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
580
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
581
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
582
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
583
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
584
        """Set the base revision to use for the merge.
585
586
        :param base_revision: A 2-list containing a path and revision number.
587
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
588
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
589
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
590
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
591
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
592
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
593
            if base_revision[1] == -1:
594
                self.base_rev_id = base_branch.last_revision()
595
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
596
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
597
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
598
                self.base_rev_id = _mod_revision.ensure_null(
599
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
600
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
601
3008.1.8 by Michael Hudson
extract merger creation into a method
602
    def make_merger(self):
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
603
        kwargs = {'working_tree': self.this_tree, 'this_tree': self.this_tree,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
604
                  'other_tree': self.other_tree,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
605
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
606
                  'this_branch': self.this_branch,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
607
                  'other_branch': self.other_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
608
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
609
        if self.merge_type.requires_base:
610
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
611
        if self.merge_type.supports_reprocess:
612
            kwargs['reprocess'] = self.reprocess
613
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
614
            raise errors.BzrError(
615
                "Conflict reduction is not supported for merge"
616
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
617
        if self.merge_type.supports_show_base:
618
            kwargs['show_base'] = self.show_base
619
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
620
            raise errors.BzrError("Showing base is not supported for this"
621
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
622
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
623
            and not self.base_is_other_ancestor):
624
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
625
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
626
            kwargs['cherrypick'] = (not self.base_is_ancestor or
627
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
628
        if self._is_criss_cross and getattr(self.merge_type,
629
                                            'supports_lca_trees', False):
630
            kwargs['lca_trees'] = self._lca_trees
6719.1.2 by Jelmer Vernooij
Fix some tests.
631
        return self.merge_type(change_reporter=self.change_reporter,
3008.1.8 by Michael Hudson
extract merger creation into a method
632
                               **kwargs)
633
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
634
    def _do_merge_to(self):
635
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
636
        if self.other_branch is not None:
637
            self.other_branch.update_references(self.this_branch)
6388.1.4 by Jelmer Vernooij
Fix tests.
638
        for hook in Merger.hooks['pre_merge']:
639
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
640
        merge.do_merge()
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
641
        for hook in Merger.hooks['post_merge']:
642
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
643
        if self.recurse == 'down':
644
            for relpath, file_id in self.this_tree.iter_references():
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
645
                sub_tree = self.this_tree.get_nested_tree(relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
646
                other_revision = self.other_tree.get_reference_revision(
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
647
                    relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
648
                if  other_revision == sub_tree.last_revision():
649
                    continue
650
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
651
                sub_merge.merge_type = self.merge_type
6926.2.5 by Jelmer Vernooij
Swap order for nested tree functions.
652
                other_branch = self.other_branch.reference_parent(
653
                    relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
654
                sub_merge.set_other_revision(other_revision, other_branch)
6883.5.3 by Jelmer Vernooij
Add find_previous_path.
655
                base_tree_path = _mod_tree.find_previous_path(
656
                    self.this_tree, self.base_tree, relpath)
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
657
                base_revision = self.base_tree.get_reference_revision(
658
                    base_tree_path, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
659
                sub_merge.base_tree = \
660
                    sub_tree.branch.repository.revision_tree(base_revision)
661
                sub_merge.base_rev_id = base_revision
662
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
663
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
664
3008.1.8 by Michael Hudson
extract merger creation into a method
665
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
666
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
667
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
668
        operation.add_cleanup(self.this_tree.unlock)
669
        if self.base_tree is not None:
670
            self.base_tree.lock_read()
671
            operation.add_cleanup(self.base_tree.unlock)
672
        if self.other_tree is not None:
673
            self.other_tree.lock_read()
674
            operation.add_cleanup(self.other_tree.unlock)
675
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
676
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
677
            if not self.ignore_zero and not trace.is_quiet():
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
678
                trace.note(gettext("All changes applied successfully."))
1534.7.141 by Aaron Bentley
Added conflict reporting
679
        else:
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
680
            trace.note(gettext("%d conflicts encountered.")
4721.3.1 by Vincent Ladeuil
Cleanup imports.
681
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
682
1534.7.134 by Aaron Bentley
Hid raw conflicts
683
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
684
1545.2.4 by Aaron Bentley
PEP8 fixes
685
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
686
class _InventoryNoneEntry(object):
687
    """This represents an inventory entry which *isn't there*.
688
689
    It simplifies the merging logic if we always have an InventoryEntry, even
690
    if it isn't actually present
691
    """
692
    executable = None
693
    kind = None
694
    name = None
695
    parent_id = None
696
    revision = None
697
    symlink_target = None
698
    text_sha1 = None
699
700
_none_entry = _InventoryNoneEntry()
701
702
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
703
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
704
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
705
    requires_base = True
706
    supports_reprocess = True
707
    supports_show_base = True
708
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
709
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
710
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
711
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
712
    supports_lca_trees = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
713
    requires_file_merge_plan = False
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
714
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
715
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
716
                 reprocess=False, show_base=False,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
717
                 change_reporter=None, interesting_files=None, do_merge=True,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
718
                 cherrypick=False, lca_trees=None, this_branch=None,
719
                 other_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
720
        """Initialize the merger object and perform the merge.
721
722
        :param working_tree: The working tree to apply the merge to
723
        :param this_tree: The local tree in the merge operation
724
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
725
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
726
        :param this_branch: The branch associated with this_tree.  Defaults to
727
            this_tree.branch if not supplied.
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
728
        :param other_branch: The branch associated with other_tree, if any.
2590.2.10 by Aaron Bentley
Updates from review
729
        :param: reprocess If True, perform conflict-reduction processing.
730
        :param show_base: If True, show the base revision in text conflicts.
731
            (incompatible with reprocess)
732
        :param change_reporter: An object that should report changes made
733
        :param interesting_files: The tree-relative paths of files that should
734
            participate in the merge.  If these paths refer to directories,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
735
            the contents of those directories will also be included.  If not
736
            specified, all files may participate in the
2590.2.10 by Aaron Bentley
Updates from review
737
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
738
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
739
            if the ancestry was found to include a criss-cross merge.
740
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
741
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
742
        object.__init__(self)
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
743
        if this_branch is None:
744
            this_branch = this_tree.branch
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
745
        self.interesting_files = interesting_files
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
746
        self.working_tree = working_tree
747
        self.this_tree = this_tree
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
748
        self.base_tree = base_tree
749
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
750
        self.this_branch = this_branch
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
751
        self.other_branch = other_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
752
        self._raw_conflicts = []
753
        self.cooked_conflicts = []
754
        self.reprocess = reprocess
755
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
756
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
757
        # Uncommenting this will change the default algorithm to always use
758
        # _entries_lca. This can be useful for running the test suite and
759
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
760
        # if lca_trees is None:
761
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
762
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
763
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
764
        if do_merge:
765
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
766
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
767
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
768
        operation = cleanup.OperationWithCleanups(self._do_merge)
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
769
        self.working_tree.lock_tree_write()
770
        operation.add_cleanup(self.working_tree.unlock)
771
        self.this_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
772
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
773
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
774
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
775
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
776
        operation.add_cleanup(self.other_tree.unlock)
777
        operation.run()
778
779
    def _do_merge(self, operation):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
780
        self.tt = transform.TreeTransform(self.working_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
781
        operation.add_cleanup(self.tt.finalize)
782
        self._compute_transform()
783
        results = self.tt.apply(no_conflicts=True)
784
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
785
        try:
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
786
            self.working_tree.add_conflicts(self.cooked_conflicts)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
787
        except errors.UnsupportedOperation:
788
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
789
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
790
    def make_preview_transform(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
791
        operation = cleanup.OperationWithCleanups(self._make_preview_transform)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
792
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
793
        operation.add_cleanup(self.base_tree.unlock)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
794
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
795
        operation.add_cleanup(self.other_tree.unlock)
796
        return operation.run_simple()
797
798
    def _make_preview_transform(self):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
799
        self.tt = transform.TransformPreview(self.working_tree)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
800
        self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
801
        return self.tt
802
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
803
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
804
        if self._lca_trees is None:
805
            entries = self._entries3()
806
            resolver = self._three_way
807
        else:
808
            entries = self._entries_lca()
809
            resolver = self._lca_multi_way
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
810
        # Prepare merge hooks
811
        factories = Merger.hooks['merge_file_content']
812
        # One hook for each registered one plus our default merger
813
        hooks = [factory(self) for factory in factories] + [self]
814
        self.active_hooks = [hook for hook in hooks if hook is not None]
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
815
        with ui.ui_factory.nested_progress_bar() as child_pb:
6883.10.1 by Jelmer Vernooij
Fix more tets.
816
            for num, (file_id, changed, paths3, parents3, names3,
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
817
                      executable3) in enumerate(entries):
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
818
                # Try merging each entry
819
                child_pb.update(gettext('Preparing file merge'),
820
                                num, len(entries))
6883.10.1 by Jelmer Vernooij
Fix more tets.
821
                self._merge_names(file_id, paths3, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
822
                if changed:
6883.10.1 by Jelmer Vernooij
Fix more tets.
823
                    file_status = self._do_merge_contents(paths3, file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
824
                else:
825
                    file_status = 'unmodified'
6883.10.1 by Jelmer Vernooij
Fix more tets.
826
                self._merge_executable(paths3, file_id, executable3,
827
                        file_status, resolver=resolver)
5993.2.4 by Jelmer Vernooij
Remove feature flag.
828
        self.tt.fixup_new_roots()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
829
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
830
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
831
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
832
        """Finalize the transform and report the changes.
833
834
        This is the second half of _compute_transform.
835
        """
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
836
        with ui.ui_factory.nested_progress_bar() as child_pb:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
837
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
838
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
839
        if self.change_reporter is not None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
840
            from breezy import delta
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
841
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
842
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
843
        self.cook_conflicts(fs_conflicts)
844
        for conflict in self.cooked_conflicts:
6973.6.4 by Jelmer Vernooij
Avoid text_type()
845
            trace.warning('%s', conflict.describe())
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
846
2590.2.4 by Aaron Bentley
Move entry generation to a helper
847
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
848
        """Gather data about files modified between three trees.
849
850
        Return a list of tuples of file_id, changed, parents3, names3,
851
        executable3.  changed is a boolean indicating whether the file contents
852
        or kind were changed.  parents3 is a tuple of parent ids for base,
853
        other and this.  names3 is a tuple of names for base, other and this.
854
        executable3 is a tuple of execute-bit values for base, other and this.
855
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
856
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
857
        iterator = self.other_tree.iter_changes(self.base_tree,
5783.2.1 by John Arbash Meinel
Remove the 'include_unchanged=True' from iter_changes.
858
                specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
859
                extra_trees=[self.this_tree])
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
860
        this_interesting_files = self.this_tree.find_related_paths_across_trees(
861
                self.interesting_files, trees=[self.other_tree])
6883.10.1 by Jelmer Vernooij
Fix more tets.
862
        this_entries = dict(self.this_tree.iter_entries_by_dir(
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
863
                            specific_files=this_interesting_files))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
864
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
865
             executable) in iterator:
6883.10.2 by Jelmer Vernooij
Resolve TODO
866
            if paths[0] is not None:
867
                this_path = _mod_tree.find_previous_path(
868
                        self.base_tree, self.this_tree, paths[0])
6883.10.1 by Jelmer Vernooij
Fix more tets.
869
            else:
6883.10.2 by Jelmer Vernooij
Resolve TODO
870
                this_path = _mod_tree.find_previous_path(
871
                        self.other_tree, self.this_tree, paths[1])
872
            this_entry = this_entries.get(this_path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
873
            if this_entry is not None:
874
                this_name = this_entry.name
875
                this_parent = this_entry.parent_id
876
                this_executable = this_entry.executable
2590.2.4 by Aaron Bentley
Move entry generation to a helper
877
            else:
878
                this_name = None
879
                this_parent = None
880
                this_executable = None
881
            parents3 = parents + (this_parent,)
882
            names3 = names + (this_name,)
6883.10.1 by Jelmer Vernooij
Fix more tets.
883
            paths3 = paths + (this_path, )
2590.2.4 by Aaron Bentley
Move entry generation to a helper
884
            executable3 = executable + (this_executable,)
6883.10.1 by Jelmer Vernooij
Fix more tets.
885
            result.append((file_id, changed, paths3, parents3, names3, executable3))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
886
        return result
887
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
888
    def _entries_lca(self):
889
        """Gather data about files modified between multiple trees.
890
891
        This compares OTHER versus all LCA trees, and for interesting entries,
892
        it then compares with THIS and BASE.
893
894
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
895
6883.10.1 by Jelmer Vernooij
Fix more tets.
896
        :return: [(file_id, changed, paths, parents, names, executable)], where:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
897
898
            * file_id: Simple file_id of the entry
899
            * changed: Boolean, True if the kind or contents changed else False
6883.10.1 by Jelmer Vernooij
Fix more tets.
900
            * paths: ((base, [path, in, lcas]), path_other, path_this)
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
901
            * parents: ((base, [parent_id, in, lcas]), parent_id_other,
902
                        parent_id_this)
903
            * names:   ((base, [name, in, lcas]), name_in_other, name_in_this)
904
            * executable: ((base, [exec, in, lcas]), exec_in_other,
905
                        exec_in_this)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
906
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
907
        if self.interesting_files is not None:
908
            lookup_trees = [self.this_tree, self.base_tree]
909
            lookup_trees.extend(self._lca_trees)
910
            # I think we should include the lca trees as well
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
911
            interesting_files = self.other_tree.find_related_paths_across_trees(
912
                    self.interesting_files, lookup_trees)
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
913
        else:
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
914
            interesting_files = None
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
915
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
916
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
917
6405.2.10 by Jelmer Vernooij
Fix more tests.
918
        base_inventory = self.base_tree.root_inventory
919
        this_inventory = self.this_tree.root_inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
920
        for path, file_id, other_ie, lca_values in walker.iter_all():
921
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
922
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
923
                other_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
924
                other_path = None
925
            else:
926
                other_path = self.other_tree.id2path(file_id)
6883.10.3 by Jelmer Vernooij
Merge trunk.
927
            if interesting_files is not None and other_path not in interesting_files:
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
928
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
929
3514.4.30 by John Arbash Meinel
Several updates.
930
            # If other_revision is found in any of the lcas, that means this
931
            # node is uninteresting. This is because when merging, if there are
932
            # multiple heads(), we have to create a new node. So if we didn't,
933
            # we know that the ancestry is linear, and that OTHER did not
934
            # modify anything
935
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
936
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
937
            if other_revision is not None:
938
                # We can't use this shortcut when other_revision is None,
939
                # because it may be None because things are WorkingTrees, and
940
                # not because it is *actually* None.
941
                is_unmodified = False
942
                for lca_path, ie in lca_values:
943
                    if ie is not None and ie.revision == other_revision:
944
                        is_unmodified = True
945
                        break
946
                if is_unmodified:
947
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
948
949
            lca_entries = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
950
            lca_paths = []
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
951
            for lca_path, lca_ie in lca_values:
952
                if lca_ie is None:
953
                    lca_entries.append(_none_entry)
6883.10.1 by Jelmer Vernooij
Fix more tets.
954
                    lca_paths.append(None)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
955
                else:
956
                    lca_entries.append(lca_ie)
6928.1.2 by Jelmer Vernooij
Fix path specification.
957
                    lca_paths.append(lca_path)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
958
6883.7.12 by Jelmer Vernooij
avoid has_id.
959
            try:
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
960
                base_ie = base_inventory.get_entry(file_id)
6883.7.12 by Jelmer Vernooij
avoid has_id.
961
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
962
                base_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
963
                base_path = None
964
            else:
965
                base_path = self.base_tree.id2path(file_id)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
966
6883.7.12 by Jelmer Vernooij
avoid has_id.
967
            try:
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
968
                this_ie = this_inventory.get_entry(file_id)
6883.7.12 by Jelmer Vernooij
avoid has_id.
969
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
970
                this_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
971
                this_path = None
972
            else:
973
                this_path = self.this_tree.id2path(file_id)
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
974
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
975
            lca_kinds = []
976
            lca_parent_ids = []
977
            lca_names = []
978
            lca_executable = []
979
            for lca_ie in lca_entries:
980
                lca_kinds.append(lca_ie.kind)
981
                lca_parent_ids.append(lca_ie.parent_id)
982
                lca_names.append(lca_ie.name)
983
                lca_executable.append(lca_ie.executable)
984
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
985
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
986
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
987
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
988
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
989
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
990
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
991
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
992
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
993
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
994
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
995
            content_changed = True
996
            if kind_winner == 'this':
997
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
998
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
999
                    if parent_id_winner == 'this' and name_winner == 'this':
1000
                        # No change for this directory in OTHER, skip
1001
                        continue
1002
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1003
                elif other_ie.kind is None or other_ie.kind == 'file':
6883.10.1 by Jelmer Vernooij
Fix more tets.
1004
                    def get_sha1(tree, path):
1005
                        if path is None:
1006
                            return None
1007
                        try:
1008
                            return tree.get_file_sha1(path, file_id)
1009
                        except errors.NoSuchFile:
1010
                            return None
1011
                    base_sha1 = get_sha1(self.base_tree, base_path)
6928.1.2 by Jelmer Vernooij
Fix path specification.
1012
                    lca_sha1s = [get_sha1(tree, lca_path)
1013
                                 for tree, lca_path
6883.10.1 by Jelmer Vernooij
Fix more tets.
1014
                                 in zip(self._lca_trees, lca_paths)]
1015
                    this_sha1 = get_sha1(self.this_tree, this_path)
1016
                    other_sha1 = get_sha1(self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1017
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1018
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1019
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1020
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1021
                        (base_ie.executable, lca_executable),
1022
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1023
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1024
                        and sha1_winner == 'this' and exec_winner == 'this'):
1025
                        # No kind, parent, name, exec, or content change for
1026
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1027
                        continue
1028
                    if sha1_winner == 'this':
1029
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1030
                elif other_ie.kind == 'symlink':
6883.10.1 by Jelmer Vernooij
Fix more tets.
1031
                    def get_target(ie, tree, path):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1032
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1033
                            return None
6809.4.21 by Jelmer Vernooij
Fix long lines.
1034
                        return tree.get_symlink_target(path, file_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1035
                    base_target = get_target(base_ie, self.base_tree, base_path)
1036
                    lca_targets = [get_target(ie, tree, lca_path) for ie, tree, lca_path
1037
                                   in zip(lca_entries, self._lca_trees, lca_paths)]
1038
                    this_target = get_target(this_ie, self.this_tree, this_path)
1039
                    other_target = get_target(other_ie, self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1040
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1041
                        (base_target, lca_targets),
1042
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1043
                    if (parent_id_winner == 'this' and name_winner == 'this'
1044
                        and target_winner == 'this'):
1045
                        # No kind, parent, name, or symlink target change
1046
                        # not interesting
1047
                        continue
1048
                    if target_winner == 'this':
1049
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1050
                elif other_ie.kind == 'tree-reference':
1051
                    # The 'changed' information seems to be handled at a higher
1052
                    # level. At least, _entries3 returns False for content
1053
                    # changed, even when at a new revision_id.
1054
                    content_changed = False
1055
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1056
                        # Nothing interesting
1057
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1058
                else:
1059
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1060
1061
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1062
            result.append((file_id, content_changed,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1063
                           ((base_path, lca_paths),
1064
                            other_path, this_path),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1065
                           ((base_ie.parent_id, lca_parent_ids),
1066
                            other_ie.parent_id, this_ie.parent_id),
1067
                           ((base_ie.name, lca_names),
1068
                            other_ie.name, this_ie.name),
1069
                           ((base_ie.executable, lca_executable),
1070
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1071
                          ))
1072
        return result
1073
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1074
    def write_modified(self, results):
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1075
        if not self.working_tree.supports_merge_modified():
1076
            return
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1077
        modified_hashes = {}
1078
        for path in results.modified_paths:
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1079
            wt_relpath = self.working_tree.relpath(path)
1080
            file_id = self.working_tree.path2id(wt_relpath)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1081
            if file_id is None:
1082
                continue
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1083
            hash = self.working_tree.get_file_sha1(wt_relpath, file_id)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1084
            if hash is None:
1085
                continue
1086
            modified_hashes[file_id] = hash
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1087
        self.working_tree.set_merge_modified(modified_hashes)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1088
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1089
    @staticmethod
1090
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1091
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1092
        if entry is None:
1093
            return None
1094
        return entry.parent_id
1095
1096
    @staticmethod
1097
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1098
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1099
        if entry is None:
1100
            return None
1101
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1102
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1103
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1104
    def contents_sha1(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1105
        """Determine the sha1 of the file contents (used as a key method)."""
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1106
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1107
            return tree.get_file_sha1(path, file_id)
1108
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1109
            return None
1110
1111
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1112
    def executable(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1113
        """Determine the executability of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1114
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1115
            if tree.kind(path, file_id) != "file":
1116
                return False
1117
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1118
            return None
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1119
        return tree.is_executable(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1120
1121
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1122
    def kind(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1123
        """Determine the kind of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1124
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1125
            return tree.kind(path, file_id)
1126
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1127
            return None
1128
1129
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1130
    def _three_way(base, other, this):
1131
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1132
            # if 'base == other', either they all agree, or only 'this' has
1133
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1134
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1135
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1136
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1137
            return 'conflict'
1138
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1139
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1140
            return "this"
1141
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1142
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1143
            return "other"
1144
1145
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1146
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1147
        """Consider LCAs when determining whether a change has occurred.
1148
1149
        If LCAS are all identical, this is the same as a _three_way comparison.
1150
1151
        :param bases: value in (BASE, [LCAS])
1152
        :param other: value in OTHER
1153
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1154
        :param allow_overriding_lca: If there is more than one unique lca
1155
            value, allow OTHER to override THIS if it has a new value, and
1156
            THIS only has an lca value, or vice versa. This is appropriate for
1157
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1158
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1159
            changed or not.
1160
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1161
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1162
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1163
        if other == this:
1164
            # Either Ambiguously clean, or nothing was actually changed. We
1165
            # don't really care
1166
            return 'this'
1167
        base_val, lca_vals = bases
1168
        # Remove 'base_val' from the lca_vals, because it is not interesting
1169
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1170
                                      if lca_val != base_val]
1171
        if len(filtered_lca_vals) == 0:
1172
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1173
1174
        unique_lca_vals = set(filtered_lca_vals)
1175
        if len(unique_lca_vals) == 1:
1176
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1177
1178
        if allow_overriding_lca:
1179
            if other in unique_lca_vals:
1180
                if this in unique_lca_vals:
1181
                    # Each side picked a different lca, conflict
1182
                    return 'conflict'
1183
                else:
1184
                    # This has a value which supersedes both lca values, and
1185
                    # other only has an lca value
1186
                    return 'this'
1187
            elif this in unique_lca_vals:
1188
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1189
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1190
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1191
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1192
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1193
        return 'conflict'
1194
6883.22.13 by Jelmer Vernooij
Actually pass in None file-ids to BranchBuilder.
1195
    def merge_names(self, paths):
1196
        def get_entry(tree, path):
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1197
            try:
6883.22.13 by Jelmer Vernooij
Actually pass in None file-ids to BranchBuilder.
1198
                return next(tree.iter_entries_by_dir(specific_files=[path]))[1]
1199
            except StopIteration:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1200
                return None
6883.22.13 by Jelmer Vernooij
Actually pass in None file-ids to BranchBuilder.
1201
        used_base_path, other_path, this_path = paths
1202
        this_entry = get_entry(self.this_tree, this_path)
1203
        other_entry = get_entry(self.other_tree, other_path)
1204
        base_entry = get_entry(self.base_tree, base_path)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1205
        entries = (base_entry, other_entry, this_entry)
1206
        names = []
1207
        parents = []
1208
        for entry in entries:
1209
            if entry is None:
1210
                names.append(None)
1211
                parents.append(None)
1212
            else:
1213
                names.append(entry.name)
1214
                parents.append(entry.parent_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1215
        return self._merge_names(file_id, paths, parents, names,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1216
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1217
6883.10.1 by Jelmer Vernooij
Fix more tets.
1218
    def _merge_names(self, file_id, paths, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1219
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1220
        base_name, other_name, this_name = names
1221
        base_parent, other_parent, this_parent = parents
6883.10.1 by Jelmer Vernooij
Fix more tets.
1222
        unused_base_path, other_path, this_path = paths
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1223
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1224
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1225
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1226
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1227
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1228
            if name_winner == "this":
1229
                name_winner = "other"
1230
            if parent_id_winner == "this":
1231
                parent_id_winner = "other"
1232
        if name_winner == "this" and parent_id_winner == "this":
1233
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1234
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1235
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1236
            # road if a ContentConflict needs to be created so we should not do
1237
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1238
            trans_id = self.tt.trans_id_file_id(file_id)
1239
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1240
                                        this_parent, this_name,
1241
                                        other_parent, other_name))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1242
        if other_path is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1243
            # it doesn't matter whether the result was 'other' or
5954.4.6 by Aaron Bentley
Updates from review.
1244
            # 'conflict'-- if it has no file id, we leave it alone.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1245
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1246
        parent_id = parents[self.winner_idx[parent_id_winner]]
5954.4.2 by Aaron Bentley
Support merging into null tree.
1247
        name = names[self.winner_idx[name_winner]]
1248
        if parent_id is not None or name is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1249
            # if we get here, name_winner and parent_winner are set to safe
1250
            # values.
5954.4.2 by Aaron Bentley
Support merging into null tree.
1251
            if parent_id is None and name is not None:
1252
                # if parent_id is None and name is non-None, current file is
1253
                # the tree root.
1254
                if names[self.winner_idx[parent_id_winner]] != '':
1255
                    raise AssertionError(
1256
                        'File looks like a root, but named %s' %
1257
                        names[self.winner_idx[parent_id_winner]])
1258
                parent_trans_id = transform.ROOT_PARENT
1259
            else:
1260
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1261
            self.tt.adjust_path(name, parent_trans_id,
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1262
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1263
6883.10.1 by Jelmer Vernooij
Fix more tets.
1264
    def _do_merge_contents(self, paths, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1265
        """Performs a merge on file_id contents."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1266
        def contents_pair(tree, path):
1267
            if path is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1268
                return (None, None)
6809.4.17 by Jelmer Vernooij
One more :)
1269
            try:
1270
                kind = tree.kind(path, file_id)
1271
            except errors.NoSuchFile:
1272
                return (None, None)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1273
            if kind == "file":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1274
                contents = tree.get_file_sha1(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1275
            elif kind == "symlink":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1276
                contents = tree.get_symlink_target(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1277
            else:
1278
                contents = None
1279
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1280
6883.10.1 by Jelmer Vernooij
Fix more tets.
1281
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1282
        # See SPOT run.  run, SPOT, run.
1283
        # So we're not QUITE repeating ourselves; we do tricky things with
1284
        # file kind...
6883.10.1 by Jelmer Vernooij
Fix more tets.
1285
        other_pair = contents_pair(self.other_tree, other_path)
1286
        this_pair = contents_pair(self.this_tree, this_path)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1287
        if self._lca_trees:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1288
            (base_path, lca_paths) = base_path
1289
            base_pair = contents_pair(self.base_tree, base_path)
1290
            lca_pairs = [contents_pair(tree, path)
1291
                         for tree, path in zip(self._lca_trees, lca_paths)]
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1292
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1293
                                         this_pair, allow_overriding_lca=False)
1294
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1295
            base_pair = contents_pair(self.base_tree, base_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1296
            if base_pair == other_pair:
1297
                winner = 'this'
1298
            else:
1299
                # We delayed evaluating this_pair as long as we can to avoid
1300
                # unnecessary sha1 calculation
6883.10.1 by Jelmer Vernooij
Fix more tets.
1301
                this_pair = contents_pair(self.this_tree, this_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1302
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1303
        if winner == 'this':
1304
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1305
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1306
        # We have a hypothetical conflict, but if we have files, then we
1307
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1308
        trans_id = self.tt.trans_id_file_id(file_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1309
        params = MergeFileHookParams(
1310
            self, file_id, (base_path, other_path,
1311
            this_path), trans_id, this_pair[0],
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1312
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1313
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1314
        hook_status = 'not_applicable'
1315
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1316
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1317
            if hook_status != 'not_applicable':
1318
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1319
                break
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1320
        # If the merge ends up replacing the content of the file, we get rid of
1321
        # it at the end of this method (this variable is used to track the
1322
        # exceptions to this rule).
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1323
        keep_this = False
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1324
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1325
        if hook_status == 'not_applicable':
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1326
            # No merge hook was able to resolve the situation. Two cases exist:
1327
            # a content conflict or a duplicate one.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1328
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1329
            name = self.tt.final_name(trans_id)
1330
            parent_id = self.tt.final_parent(trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1331
            duplicate = False
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1332
            inhibit_content_conflict = False
1333
            if params.this_kind is None: # file_id is not in THIS
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1334
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1335
                if self.this_tree.is_versioned(other_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1336
                    # Two entries for the same path
1337
                    keep_this = True
1338
                    # versioning the merged file will trigger a duplicate
1339
                    # conflict
1340
                    self.tt.version_file(file_id, trans_id)
1341
                    transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1342
                        self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1343
                        other_path, file_id=file_id,
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1344
                        filter_tree_path=self._get_filter_tree_path(file_id))
1345
                    inhibit_content_conflict = True
1346
            elif params.other_kind is None: # file_id is not in OTHER
1347
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1348
                if self.other_tree.is_versioned(this_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1349
                    # Two entries for the same path again, but here, the other
1350
                    # entry will also be merged.  We simply inhibit the
1351
                    # 'content' conflict creation because we know OTHER will
1352
                    # create (or has already created depending on ordering) an
1353
                    # entry at the same path. This will trigger a 'duplicate'
1354
                    # conflict later.
1355
                    keep_this = True
1356
                    inhibit_content_conflict = True
1357
            if not inhibit_content_conflict:
1358
                if params.this_kind is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1359
                    self.tt.unversion_file(trans_id)
1360
                # This is a contents conflict, because none of the available
1361
                # functions could merge it.
6923.1.1 by Jelmer Vernooij
Fix regression.
1362
                file_group = self._dump_conflicts(
1363
                        name, (base_path, other_path, this_path), parent_id,
1364
                        file_id, set_version=True)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1365
                self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1366
        elif hook_status == 'success':
1367
            self.tt.create_file(lines, trans_id)
1368
        elif hook_status == 'conflicted':
1369
            # XXX: perhaps the hook should be able to provide
1370
            # the BASE/THIS/OTHER files?
1371
            self.tt.create_file(lines, trans_id)
1372
            self._raw_conflicts.append(('text conflict', trans_id))
1373
            name = self.tt.final_name(trans_id)
1374
            parent_id = self.tt.final_parent(trans_id)
6923.1.1 by Jelmer Vernooij
Fix regression.
1375
            self._dump_conflicts(
1376
                name, (base_path, other_path, this_path), parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1377
        elif hook_status == 'delete':
1378
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1379
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1380
        elif hook_status == 'done':
1381
            # The hook function did whatever it needs to do directly, no
1382
            # further action needed here.
1383
            pass
1384
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1385
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1386
        if not this_path and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1387
            self.tt.version_file(file_id, trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1388
        if not keep_this:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1389
            # The merge has been performed and produced a new content, so the
1390
            # old contents should not be retained.
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1391
            self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1392
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1393
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1394
    def _default_other_winner_merge(self, merge_hook_params):
1395
        """Replace this contents with other."""
1396
        file_id = merge_hook_params.file_id
1397
        trans_id = merge_hook_params.trans_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
1398
        if merge_hook_params.other_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1399
            # OTHER changed the file
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1400
            transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1401
                self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1402
                merge_hook_params.other_path, file_id=file_id,
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1403
                filter_tree_path=self._get_filter_tree_path(file_id))
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1404
            return 'done', None
6883.10.1 by Jelmer Vernooij
Fix more tets.
1405
        elif merge_hook_params.this_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1406
            # OTHER deleted the file
1407
            return 'delete', None
1408
        else:
1409
            raise AssertionError(
1410
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1411
                % (file_id,))
1412
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1413
    def merge_contents(self, merge_hook_params):
1414
        """Fallback merge logic after user installed hooks."""
1415
        # This function is used in merge hooks as the fallback instance.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1416
        # Perhaps making this function and the functions it calls be a
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1417
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1418
        if merge_hook_params.winner == 'other':
1419
            # OTHER is a straight winner, so replace this contents with other
1420
            return self._default_other_winner_merge(merge_hook_params)
1421
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1422
            # THIS and OTHER are both files, so text merge.  Either
1423
            # BASE is a file, or both converted to files, so at least we
1424
            # have agreement that output should be a file.
1425
            try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1426
                self.text_merge(merge_hook_params.trans_id,
1427
                                merge_hook_params.paths, merge_hook_params.file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1428
            except errors.BinaryFile:
1429
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1430
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1431
        else:
1432
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1433
6883.10.1 by Jelmer Vernooij
Fix more tets.
1434
    def get_lines(self, tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1435
        """Return the lines in a file, or an empty list."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1436
        if path is None:
1437
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1438
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1439
            kind = tree.kind(path, file_id)
1440
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1441
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1442
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1443
            if kind != 'file':
1444
                return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1445
            return tree.get_file_lines(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1446
6883.10.1 by Jelmer Vernooij
Fix more tets.
1447
    def text_merge(self, trans_id, paths, file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1448
        """Perform a three-way text merge on a file_id"""
1449
        # it's possible that we got here with base as a different type.
1450
        # if so, we just want two-way text conflicts.
6883.10.1 by Jelmer Vernooij
Fix more tets.
1451
        base_path, other_path, this_path = paths
1452
        base_lines = self.get_lines(self.base_tree, base_path, file_id)
1453
        other_lines = self.get_lines(self.other_tree, other_path, file_id)
1454
        this_lines = self.get_lines(self.this_tree, this_path, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1455
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1456
                           is_cherrypick=self.cherrypick)
6973.9.1 by Jelmer Vernooij
More test fixes.
1457
        start_marker = b"!START OF MERGE CONFLICT!" + b"I HOPE THIS IS UNIQUE"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1458
        if self.show_base is True:
7045.1.1 by Jelmer Vernooij
Fix another 300 tests.
1459
            base_marker = b'|' * 7
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1460
        else:
1461
            base_marker = None
1462
1463
        def iter_merge3(retval):
1464
            retval["text_conflicts"] = False
6973.9.1 by Jelmer Vernooij
More test fixes.
1465
            for line in m3.merge_lines(name_a = b"TREE",
1466
                                       name_b = b"MERGE-SOURCE",
1467
                                       name_base = b"BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1468
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1469
                                       base_marker=base_marker,
1470
                                       reprocess=self.reprocess):
1471
                if line.startswith(start_marker):
1472
                    retval["text_conflicts"] = True
6973.9.1 by Jelmer Vernooij
More test fixes.
1473
                    yield line.replace(start_marker, b'<' * 7)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1474
                else:
1475
                    yield line
1476
        retval = {}
1477
        merge3_iterator = iter_merge3(retval)
1478
        self.tt.create_file(merge3_iterator, trans_id)
1479
        if retval["text_conflicts"] is True:
1480
            self._raw_conflicts.append(('text conflict', trans_id))
1481
            name = self.tt.final_name(trans_id)
1482
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1483
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1484
                                              this_lines, base_lines,
1485
                                              other_lines)
1486
            file_group.append(trans_id)
1487
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1488
    def _get_filter_tree_path(self, file_id):
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1489
        if self.this_tree.supports_content_filtering():
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1490
            # We get the path from the working tree if it exists.
1491
            # That fails though when OTHER is adding a file, so
1492
            # we fall back to the other tree to find the path if
1493
            # it doesn't exist locally.
1494
            try:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1495
                return self.this_tree.id2path(file_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1496
            except errors.NoSuchId:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1497
                return self.other_tree.id2path(file_id)
1498
        # Skip the id2path lookup for older formats
1499
        return None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1500
6883.10.1 by Jelmer Vernooij
Fix more tets.
1501
    def _dump_conflicts(self, name, paths, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1502
                        base_lines=None, other_lines=None, set_version=False,
1503
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1504
        """Emit conflict files.
1505
        If this_lines, base_lines, or other_lines are omitted, they will be
1506
        determined automatically.  If set_version is true, the .OTHER, .THIS
1507
        or .BASE (in that order) will be created as versioned files.
1508
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1509
        base_path, other_path, this_path = paths
1510
        data = [('OTHER', self.other_tree, other_path, other_lines),
1511
                ('THIS', self.this_tree, this_path, this_lines)]
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1512
        if not no_base:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1513
            data.append(('BASE', self.base_tree, base_path, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1514
1515
        # We need to use the actual path in the working tree of the file here,
1516
        # ignoring the conflict suffixes
1517
        wt = self.this_tree
1518
        if wt.supports_content_filtering():
1519
            try:
1520
                filter_tree_path = wt.id2path(file_id)
1521
            except errors.NoSuchId:
1522
                # file has been deleted
1523
                filter_tree_path = None
1524
        else:
1525
            # Skip the id2path lookup for older formats
1526
            filter_tree_path = None
1527
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1528
        versioned = False
1529
        file_group = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
1530
        for suffix, tree, path, lines in data:
1531
            if path is not None:
6809.4.21 by Jelmer Vernooij
Fix long lines.
1532
                trans_id = self._conflict_file(
1533
                        name, parent_id, path, tree, file_id, suffix, lines,
1534
                        filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1535
                file_group.append(trans_id)
1536
                if set_version and not versioned:
1537
                    self.tt.version_file(file_id, trans_id)
1538
                    versioned = True
1539
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1540
6809.4.21 by Jelmer Vernooij
Fix long lines.
1541
    def _conflict_file(self, name, parent_id, path, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1542
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1543
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1544
        name = name + '.' + suffix
1545
        trans_id = self.tt.create_path(name, parent_id)
6809.4.21 by Jelmer Vernooij
Fix long lines.
1546
        transform.create_from_tree(
1547
                self.tt, trans_id, tree, path,
6977.2.1 by Jelmer Vernooij
Require that get_file implementations are contect managers, simplify file handling in transform.
1548
                file_id=file_id, chunks=lines,
6809.4.21 by Jelmer Vernooij
Fix long lines.
1549
                filter_tree_path=filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1550
        return trans_id
1551
6883.10.1 by Jelmer Vernooij
Fix more tets.
1552
    def merge_executable(self, paths, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1553
        """Perform a merge on the execute bit."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1554
        executable = [self.executable(t, p, file_id) for t, p in zip([self.base_tree,
1555
                      self.other_tree, self.this_tree], paths)]
1556
        self._merge_executable(paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1557
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1558
6883.10.1 by Jelmer Vernooij
Fix more tets.
1559
    def _merge_executable(self, paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1560
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1561
        """Perform a merge on the execute bit."""
1562
        base_executable, other_executable, this_executable = executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1563
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1564
        if file_status == "deleted":
1565
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1566
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1567
        if winner == "conflict":
1568
        # There must be a None in here, if we have a conflict, but we
1569
        # need executability since file status was not deleted.
6928.1.2 by Jelmer Vernooij
Fix path specification.
1570
            if other_path is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1571
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1572
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1573
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1574
        if winner == 'this' and file_status != "modified":
1575
            return
1576
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1577
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1578
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1579
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1580
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1581
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1582
            if other_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1583
                executability = other_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1584
            elif this_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1585
                executability = this_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1586
            elif base_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1587
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1588
        if executability is not None:
1589
            trans_id = self.tt.trans_id_file_id(file_id)
1590
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1591
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1592
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1593
        """Convert all conflicts into a form that doesn't depend on trans_id"""
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1594
        content_conflict_file_ids = set()
1595
        cooked_conflicts = transform.cook_conflicts(fs_conflicts, self.tt)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1596
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1597
        for conflict in self._raw_conflicts:
1598
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1599
            if conflict_type == 'path conflict':
1600
                (trans_id, file_id,
1601
                this_parent, this_name,
1602
                other_parent, other_name) = conflict[1:]
1603
                if this_parent is None or this_name is None:
1604
                    this_path = '<deleted>'
1605
                else:
1606
                    parent_path =  fp.get_path(
1607
                        self.tt.trans_id_file_id(this_parent))
1608
                    this_path = osutils.pathjoin(parent_path, this_name)
1609
                if other_parent is None or other_name is None:
1610
                    other_path = '<deleted>'
1611
                else:
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1612
                    if other_parent == self.other_tree.get_root_id():
5050.73.9 by Vincent Ladeuil
Fix typo.
1613
                        # The tree transform doesn't know about the other root,
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1614
                        # so we special case here to avoid a NoFinalPath
1615
                        # exception
1616
                        parent_path = ''
1617
                    else:
1618
                        parent_path =  fp.get_path(
1619
                            self.tt.trans_id_file_id(other_parent))
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1620
                    other_path = osutils.pathjoin(parent_path, other_name)
1621
                c = _mod_conflicts.Conflict.factory(
1622
                    'path conflict', path=this_path,
1623
                    conflict_path=other_path,
1624
                    file_id=file_id)
1625
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1626
                for trans_id in conflict[1]:
1627
                    file_id = self.tt.final_file_id(trans_id)
1628
                    if file_id is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1629
                        # Ok we found the relevant file-id
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1630
                        break
1631
                path = fp.get_path(trans_id)
1632
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1633
                    if path.endswith(suffix):
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1634
                        # Here is the raw path
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1635
                        path = path[:-len(suffix)]
1636
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1637
                c = _mod_conflicts.Conflict.factory(conflict_type,
1638
                                                    path=path, file_id=file_id)
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1639
                content_conflict_file_ids.add(file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1640
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1641
                trans_id = conflict[1]
1642
                path = fp.get_path(trans_id)
1643
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1644
                c = _mod_conflicts.Conflict.factory(conflict_type,
1645
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1646
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1647
                raise AssertionError('bad conflict type: %r' % (conflict,))
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1648
            cooked_conflicts.append(c)
5988.2.2 by Vincent Ladeuil
Make it clear that we start from an empty cooked_conflicts list.
1649
1650
        self.cooked_conflicts = []
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1651
        # We want to get rid of path conflicts when a corresponding contents
1652
        # conflict exists. This can occur when one branch deletes a file while
1653
        # the other renames *and* modifies it. In this case, the content
1654
        # conflict is enough.
1655
        for c in cooked_conflicts:
1656
            if (c.typestring == 'path conflict'
1657
                and c.file_id in content_conflict_file_ids):
1658
                continue
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1659
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1660
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1661
1662
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1663
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1664
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1665
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1666
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1667
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1668
    history_based = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1669
    requires_file_merge_plan = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1670
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1671
    def _generate_merge_plan(self, file_id, base):
1672
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1673
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1674
1675
    def _merged_lines(self, file_id):
1676
        """Generate the merged lines.
1677
        There is no distinction between lines that are meant to contain <<<<<<<
1678
        and conflicts.
1679
        """
1680
        if self.cherrypick:
1681
            base = self.base_tree
1682
        else:
1683
            base = None
1684
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1685
        if 'merge' in debug.debug_flags:
1686
            plan = list(plan)
1687
            trans_id = self.tt.trans_id_file_id(file_id)
1688
            name = self.tt.final_name(trans_id) + '.plan'
7029.4.1 by Jelmer Vernooij
Fix a bunch of merge tests.
1689
            contents = (b'%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1690
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
7029.4.1 by Jelmer Vernooij
Fix a bunch of merge tests.
1691
        textmerge = versionedfile.PlanWeaveMerge(plan, b'<<<<<<< TREE\n',
1692
                                                 b'>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1693
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1694
        if conflicts:
1695
            base_lines = textmerge.base_from_plan()
1696
        else:
1697
            base_lines = None
1698
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1699
6883.10.1 by Jelmer Vernooij
Fix more tets.
1700
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1701
        """Perform a (weave) text merge for a given file and file-id.
1702
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1703
        and a conflict will be noted.
1704
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1705
        base_path, other_path, this_path = paths
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1706
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1707
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1708
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1709
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1710
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1711
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1712
        if base_lines is not None:
1713
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1714
            self._raw_conflicts.append(('text conflict', trans_id))
1715
            name = self.tt.final_name(trans_id)
1716
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1717
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1718
                                              no_base=False,
1719
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1720
            file_group.append(trans_id)
1721
1722
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1723
class LCAMerger(WeaveMerger):
1724
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1725
    requires_file_merge_plan = True
1726
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1727
    def _generate_merge_plan(self, file_id, base):
1728
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1729
                                                  base=base)
1730
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1731
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1732
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1733
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1734
    requires_file_merge_plan = False
1735
6883.10.1 by Jelmer Vernooij
Fix more tets.
1736
    def dump_file(self, temp_dir, name, tree, path, file_id=None):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1737
        out_path = osutils.pathjoin(temp_dir, name)
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1738
        with open(out_path, "wb") as out_file:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1739
            in_file = tree.get_file(path, file_id=None)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1740
            for line in in_file:
1741
                out_file.write(line)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1742
        return out_path
1743
6883.10.1 by Jelmer Vernooij
Fix more tets.
1744
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1745
        """Perform a diff3 merge using a specified file-id and trans-id.
1746
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1747
        will be dumped, and a will be conflict noted.
1748
        """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1749
        import breezy.patch
6883.10.1 by Jelmer Vernooij
Fix more tets.
1750
        base_path, other_path, this_path = paths
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1751
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1752
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1753
            new_file = osutils.pathjoin(temp_dir, "new")
6883.10.1 by Jelmer Vernooij
Fix more tets.
1754
            this = self.dump_file(temp_dir, "this", self.this_tree, this_path, file_id)
1755
            base = self.dump_file(temp_dir, "base", self.base_tree, base_path, file_id)
1756
            other = self.dump_file(temp_dir, "other", self.other_tree, other_path, file_id)
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1757
            status = breezy.patch.diff3(new_file, this, base, other)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1758
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1759
                raise errors.BzrError("Unhandled diff3 exit code")
6861.2.1 by Jelmer Vernooij
vf Move file planning to breezy.bzr.inventorytree.
1760
            with open(new_file, 'rb') as f:
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1761
                self.tt.create_file(f, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1762
            if status == 1:
1763
                name = self.tt.final_name(trans_id)
1764
                parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1765
                self._dump_conflicts(name, paths, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1766
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1767
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1768
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1769
1770
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1771
class PathNotInTree(errors.BzrError):
1772
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1773
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1774
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1775
    def __init__(self, path, tree):
1776
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1777
1778
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1779
class MergeIntoMerger(Merger):
1780
    """Merger that understands other_tree will be merged into a subdir.
1781
1782
    This also changes the Merger api so that it uses real Branch, revision_id,
1783
    and RevisonTree objects, rather than using revision specs.
1784
    """
1785
1786
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
5246.2.22 by Andrew Bennetts
Minor tweaks.
1787
            source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1788
        """Create a new MergeIntoMerger object.
1789
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1790
        source_subpath in other_tree will be effectively copied to
1791
        target_subdir in this_tree.
1792
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1793
        :param this_tree: The tree that we will be merging into.
1794
        :param other_branch: The Branch we will be merging from.
1795
        :param other_tree: The RevisionTree object we want to merge.
1796
        :param target_subdir: The relative path where we want to merge
1797
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1798
        :param source_subpath: The relative path specifying the subtree of
1799
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1800
        """
1801
        # It is assumed that we are merging a tree that is not in our current
1802
        # ancestry, which means we are using the "EmptyTree" as our basis.
1803
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
1804
                                _mod_revision.NULL_REVISION)
1805
        super(MergeIntoMerger, self).__init__(
1806
            this_branch=this_tree.branch,
1807
            this_tree=this_tree,
1808
            other_tree=other_tree,
1809
            base_tree=null_ancestor_tree,
1810
            )
1811
        self._target_subdir = target_subdir
1812
        self._source_subpath = source_subpath
1813
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1814
        if other_rev_id is None:
1815
            other_rev_id = other_tree.get_revision_id()
1816
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1817
        self.base_is_ancestor = True
1818
        self.backup_files = True
1819
        self.merge_type = Merge3Merger
1820
        self.show_base = False
1821
        self.reprocess = False
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1822
        self.interesting_files = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1823
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
1824
              target_subdir=self._target_subdir,
1825
              source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1826
        if self._source_subpath != '':
1827
            # If this isn't a partial merge make sure the revisions will be
1828
            # present.
1829
            self._maybe_fetch(self.other_branch, self.this_branch,
1830
                self.other_basis)
1831
1832
    def set_pending(self):
1833
        if self._source_subpath != '':
1834
            return
1835
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1836
1837
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1838
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1839
    """Wrap a merge-type class to provide extra parameters.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1840
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1841
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1842
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1843
    the 'merge_type' member.  It is difficult override do_merge without
1844
    re-writing the whole thing, so instead we create a wrapper which will pass
1845
    the extra parameters.
1846
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1847
1848
    def __init__(self, merge_type, **kwargs):
1849
        self._extra_kwargs = kwargs
1850
        self._merge_type = merge_type
1851
1852
    def __call__(self, *args, **kwargs):
1853
        kwargs.update(self._extra_kwargs)
1854
        return self._merge_type(*args, **kwargs)
1855
1856
    def __getattr__(self, name):
1857
        return getattr(self._merge_type, name)
1858
1859
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1860
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1861
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1862
1863
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1864
        """Initialize the merger object.
1865
1866
        :param args: See Merge3Merger.__init__'s args.
1867
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1868
            source_subpath and target_subdir.
1869
        :keyword source_subpath: The relative path specifying the subtree of
1870
            other_tree to merge into this_tree.
1871
        :keyword target_subdir: The relative path where we want to merge
1872
            other_tree into this_tree
1873
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1874
        # All of the interesting work happens during Merge3Merger.__init__(),
1875
        # so we have have to hack in to get our extra parameters set.
1876
        self._source_subpath = kwargs.pop('source_subpath')
1877
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1878
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1879
1880
    def _compute_transform(self):
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
1881
        with ui.ui_factory.nested_progress_bar() as child_pb:
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1882
            entries = self._entries_to_incorporate()
1883
            entries = list(entries)
6874.2.9 by Jelmer Vernooij
Fix test.
1884
            for num, (entry, parent_id, relpath) in enumerate(entries):
6138.4.1 by Jonathan Riddell
add gettext to progress bar strings
1885
                child_pb.update(gettext('Preparing file merge'), num, len(entries))
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1886
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
6874.2.9 by Jelmer Vernooij
Fix test.
1887
                path = osutils.pathjoin(self._source_subpath, relpath)
6874.2.8 by Jelmer Vernooij
Fix test.
1888
                trans_id = transform.new_by_entry(path, self.tt, entry,
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1889
                    parent_trans_id, self.other_tree)
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1890
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1891
1892
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1893
        """Yields pairs of (inventory_entry, new_parent)."""
6405.2.10 by Jelmer Vernooij
Fix more tests.
1894
        other_inv = self.other_tree.root_inventory
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1895
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1896
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1897
            # XXX: The error would be clearer if it gave the URL of the source
1898
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1899
            raise PathNotInTree(self._source_subpath, "Source tree")
6915.4.2 by Jelmer Vernooij
Remove __getitem__ and __iter__ from Inventory.
1900
        subdir = other_inv.get_entry(subdir_id)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1901
        parent_in_target = osutils.dirname(self._target_subdir)
6405.2.10 by Jelmer Vernooij
Fix more tests.
1902
        target_id = self.this_tree.path2id(parent_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1903
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1904
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1905
        name_in_target = osutils.basename(self._target_subdir)
1906
        merge_into_root = subdir.copy()
1907
        merge_into_root.name = name_in_target
6405.2.10 by Jelmer Vernooij
Fix more tests.
1908
        if self.this_tree.has_id(merge_into_root.file_id):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1909
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1910
            # This can happen fairly easily if the directory we are
1911
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1912
            # their root_id.  Users will expect this to Just Work, so we
1913
            # change the file-id here.
1914
            # Non-root file-ids could potentially conflict too.  That's really
1915
            # an edge case, so we don't do anything special for those.  We let
1916
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1917
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1918
        yield (merge_into_root, target_id, '')
5246.2.10 by Andrew Bennetts
Add more tests.
1919
        if subdir.kind != 'directory':
1920
            # No children, so we are done.
1921
            return
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1922
        for path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1923
            parent_id = entry.parent_id
1924
            if parent_id == subdir.file_id:
1925
                # The root's parent ID has changed, so make sure children of
1926
                # the root refer to the new ID.
1927
                parent_id = merge_into_root.file_id
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1928
            yield (entry, parent_id, path)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1929
1930
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1931
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1932
                backup_files=False,
1933
                merge_type=Merge3Merger,
1934
                show_base=False,
1935
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1936
                other_rev_id=None,
1937
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1938
                this_tree=None,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
1939
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1940
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1941
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1942
    Typical use is probably::
1943
1944
        merge_inner(branch, branch.get_revision_tree(other_revision),
1945
                    branch.get_revision_tree(base_revision))
1946
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1947
    if this_tree is None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1948
        raise errors.BzrError("breezy.merge.merge_inner requires a this_tree "
5993.2.1 by Jelmer Vernooij
Add test for rootless tree merge.
1949
                              "parameter")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1950
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
6719.1.2 by Jelmer Vernooij
Fix some tests.
1951
                    change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1952
    merger.backup_files = backup_files
1953
    merger.merge_type = merge_type
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1954
    merger.ignore_zero = ignore_zero
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1955
    merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1956
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1957
    merger.reprocess = reprocess
1958
    merger.other_rev_id = other_rev_id
1959
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1960
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1961
    if get_revision_id is None:
1962
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1963
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1964
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1965
    return merger.do_merge()
1966
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1967
1968
merge_type_registry = registry.Registry()
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1969
merge_type_registry.register('diff3', Diff3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1970
                             "Merge using external diff3.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1971
merge_type_registry.register('lca', LCAMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1972
                             "LCA-newness merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1973
merge_type_registry.register('merge3', Merge3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1974
                             "Native diff3-style merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1975
merge_type_registry.register('weave', WeaveMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1976
                             "Weave-based merge.")
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1977
1978
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1979
def get_merge_type_registry():
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1980
    """Merge type registry was previously in breezy.option
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1981
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1982
    This method provides a backwards compatible way to retrieve it.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1983
    """
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1984
    return merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1985
1986
1987
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1988
    def status_a(revision, text):
1989
        if revision in ancestors_b:
1990
            return 'killed-b', text
1991
        else:
1992
            return 'new-a', text
1993
1994
    def status_b(revision, text):
1995
        if revision in ancestors_a:
1996
            return 'killed-a', text
1997
        else:
1998
            return 'new-b', text
1999
2000
    plain_a = [t for (a, t) in annotated_a]
2001
    plain_b = [t for (a, t) in annotated_b]
2002
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
2003
    blocks = matcher.get_matching_blocks()
2004
    a_cur = 0
2005
    b_cur = 0
2006
    for ai, bi, l in blocks:
2007
        # process all mismatched sections
2008
        # (last mismatched section is handled because blocks always
2009
        # includes a 0-length last block)
2010
        for revision, text in annotated_a[a_cur:ai]:
2011
            yield status_a(revision, text)
2012
        for revision, text in annotated_b[b_cur:bi]:
2013
            yield status_b(revision, text)
2014
        # and now the matched section
2015
        a_cur = ai + l
2016
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
2017
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
2018
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2019
2020
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2021
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2022
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2023
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2024
        """Contructor.
2025
2026
        :param a_rev: Revision-id of one revision to merge
2027
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2028
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2029
        :param key_prefix: A prefix for accessing keys in vf, typically
2030
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2031
        """
2032
        self.a_rev = a_rev
2033
        self.b_rev = b_rev
2034
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2035
        self._last_lines = None
2036
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2037
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2038
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2039
        self._precache_tip_lines()
2040
2041
    def _precache_tip_lines(self):
2042
        lines = self.get_lines([self.a_rev, self.b_rev])
2043
        self.lines_a = lines[self.a_rev]
2044
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2045
2046
    def get_lines(self, revisions):
2047
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2048
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2049
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2050
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2051
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2052
        result = {}
2053
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2054
            if record.storage_kind == 'absent':
2055
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2056
            result[record.key[-1]] = osutils.chunks_to_lines(
2057
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2058
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2059
2060
    def plan_merge(self):
2061
        """Generate a 'plan' for merging the two revisions.
2062
2063
        This involves comparing their texts and determining the cause of
2064
        differences.  If text A has a line and text B does not, then either the
2065
        line was added to text A, or it was deleted from B.  Once the causes
2066
        are combined, they are written out in the format described in
2067
        VersionedFile.plan_merge
2068
        """
2069
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2070
        unique_a, unique_b = self._unique_lines(blocks)
2071
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2072
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2073
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2074
2075
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2076
        last_i = 0
2077
        last_j = 0
2078
        for i, j, n in blocks:
2079
            for a_index in range(last_i, i):
2080
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2081
                    if a_index in killed_b:
2082
                        yield 'conflicted-a', self.lines_a[a_index]
2083
                    else:
2084
                        yield 'new-a', self.lines_a[a_index]
2085
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2086
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2087
            for b_index in range(last_j, j):
2088
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2089
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2090
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2091
                    else:
2092
                        yield 'new-b', self.lines_b[b_index]
2093
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2094
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2095
            # handle common lines
2096
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2097
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2098
            last_i = i+n
2099
            last_j = j+n
2100
2101
    def _get_matching_blocks(self, left_revision, right_revision):
2102
        """Return a description of which sections of two revisions match.
2103
2104
        See SequenceMatcher.get_matching_blocks
2105
        """
3144.3.7 by Aaron Bentley
Update from review
2106
        cached = self._cached_matching_blocks.get((left_revision,
2107
                                                   right_revision))
2108
        if cached is not None:
2109
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2110
        if self._last_lines_revision_id == left_revision:
2111
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2112
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2113
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2114
            lines = self.get_lines([left_revision, right_revision])
2115
            left_lines = lines[left_revision]
2116
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2117
        self._last_lines = right_lines
2118
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2119
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2120
                                                       right_lines)
2121
        return matcher.get_matching_blocks()
2122
2123
    def _unique_lines(self, matching_blocks):
2124
        """Analyse matching_blocks to determine which lines are unique
2125
2126
        :return: a tuple of (unique_left, unique_right), where the values are
2127
            sets of line numbers of unique lines.
2128
        """
2129
        last_i = 0
2130
        last_j = 0
2131
        unique_left = []
2132
        unique_right = []
2133
        for i, j, n in matching_blocks:
2134
            unique_left.extend(range(last_i, i))
2135
            unique_right.extend(range(last_j, j))
2136
            last_i = i + n
2137
            last_j = j + n
2138
        return unique_left, unique_right
2139
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2140
    @staticmethod
2141
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2142
        """Remove changes from new_plan that came from old_plan.
2143
2144
        It is assumed that the difference between the old_plan and new_plan
2145
        is their choice of 'b' text.
2146
2147
        All lines from new_plan that differ from old_plan are emitted
2148
        verbatim.  All lines from new_plan that match old_plan but are
2149
        not about the 'b' revision are emitted verbatim.
2150
2151
        Lines that match and are about the 'b' revision are the lines we
2152
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2153
        is skipped entirely.
2154
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2155
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2156
                                                       new_plan)
2157
        last_j = 0
2158
        for i, j, n in matcher.get_matching_blocks():
2159
            for jj in range(last_j, j):
2160
                yield new_plan[jj]
2161
            for jj in range(j, j+n):
2162
                plan_line = new_plan[jj]
2163
                if plan_line[0] == 'new-b':
2164
                    pass
2165
                elif plan_line[0] == 'killed-b':
2166
                    yield 'unchanged', plan_line[1]
2167
                else:
2168
                    yield plan_line
2169
            last_j = j + n
2170
2171
2172
class _PlanMerge(_PlanMergeBase):
2173
    """Plan an annotate merge using on-the-fly annotation"""
2174
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2175
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2176
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2177
        self.a_key = self._key_prefix + (self.a_rev,)
2178
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2179
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2180
        heads = self.graph.heads((self.a_key, self.b_key))
2181
        if len(heads) == 1:
2182
            # one side dominates, so we can just return its values, yay for
2183
            # per-file graphs
2184
            # Ideally we would know that before we get this far
2185
            self._head_key = heads.pop()
2186
            if self._head_key == self.a_key:
2187
                other = b_rev
2188
            else:
2189
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2190
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2191
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2192
            self._weave = None
2193
        else:
2194
            self._head_key = None
2195
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2196
2197
    def _precache_tip_lines(self):
2198
        # Turn this into a no-op, because we will do this later
2199
        pass
2200
2201
    def _find_recursive_lcas(self):
2202
        """Find all the ancestors back to a unique lca"""
2203
        cur_ancestors = (self.a_key, self.b_key)
2204
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2205
        # rather than a key tuple. We will just map that directly to no common
2206
        # ancestors.
2207
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2208
        while True:
2209
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2210
            # Map a plain NULL_REVISION to a simple no-ancestors
6619.3.12 by Jelmer Vernooij
Use 2to3 set_literal fixer.
2211
            if next_lcas == {_mod_revision.NULL_REVISION}:
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2212
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2213
            # Order the lca's based on when they were merged into the tip
2214
            # While the actual merge portion of weave merge uses a set() of
2215
            # active revisions, the order of insertion *does* effect the
2216
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2217
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2218
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2219
                                                                    next_lcas))
2220
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2221
            if len(next_lcas) == 0:
2222
                break
2223
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2224
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2225
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2226
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2227
                # More than 2 lca's, fall back to grabbing all nodes between
2228
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2229
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2230
                             ' %s, %s\n=> %s',
2231
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2232
                cur_lcas = next_lcas
2233
                while len(cur_lcas) > 1:
2234
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2235
                if len(cur_lcas) == 0:
2236
                    # No common base to find, use the full ancestry
2237
                    unique_lca = None
2238
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2239
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2240
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2241
                        # find_lca will return a plain 'NULL_REVISION' rather
2242
                        # than a key tuple when there is no common ancestor, we
2243
                        # prefer to just use None, because it doesn't confuse
2244
                        # _get_interesting_texts()
2245
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2246
                parent_map.update(self._find_unique_parents(next_lcas,
2247
                                                            unique_lca))
2248
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2249
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2250
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2251
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2252
    def _find_unique_parents(self, tip_keys, base_key):
2253
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2254
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2255
        :param tip_keys: Nodes that are interesting
2256
        :param base_key: Cull all ancestors of this node
2257
        :return: The parent map for all revisions between tip_keys and
2258
            base_key. base_key will be included. References to nodes outside of
2259
            the ancestor set will also be removed.
2260
        """
2261
        # TODO: this would be simpler if find_unique_ancestors took a list
2262
        #       instead of a single tip, internally it supports it, but it
2263
        #       isn't a "backwards compatible" api change.
2264
        if base_key is None:
2265
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2266
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2267
            # thus confuses things like _get_interesting_texts, and our logic
2268
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2269
            if _mod_revision.NULL_REVISION in parent_map:
2270
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2271
        else:
2272
            interesting = set()
2273
            for tip in tip_keys:
2274
                interesting.update(
2275
                    self.graph.find_unique_ancestors(tip, [base_key]))
2276
            parent_map = self.graph.get_parent_map(interesting)
2277
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2278
        culled_parent_map, child_map, tails = self._remove_external_references(
2279
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2280
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2281
        if base_key is not None:
2282
            tails.remove(base_key)
2283
            self._prune_tails(culled_parent_map, child_map, tails)
2284
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2285
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2286
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2287
2288
    @staticmethod
2289
    def _remove_external_references(parent_map):
2290
        """Remove references that go outside of the parent map.
2291
2292
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2293
        :return: (filtered_parent_map, child_map, tails)
2294
            filtered_parent_map is parent_map without external references
2295
            child_map is the {parent_key: [child_keys]} mapping
2296
            tails is a list of nodes that do not have any parents in the map
2297
        """
2298
        # TODO: The basic effect of this function seems more generic than
2299
        #       _PlanMerge. But the specific details of building a child_map,
2300
        #       and computing tails seems very specific to _PlanMerge.
2301
        #       Still, should this be in Graph land?
2302
        filtered_parent_map = {}
2303
        child_map = {}
2304
        tails = []
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
2305
        for key, parent_keys in viewitems(parent_map):
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2306
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2307
            if not culled_parent_keys:
2308
                tails.append(key)
2309
            for parent_key in culled_parent_keys:
2310
                child_map.setdefault(parent_key, []).append(key)
2311
            # TODO: Do we want to do this, it adds overhead for every node,
2312
            #       just to say that the node has no children
2313
            child_map.setdefault(key, [])
2314
            filtered_parent_map[key] = culled_parent_keys
2315
        return filtered_parent_map, child_map, tails
2316
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2317
    @staticmethod
2318
    def _prune_tails(parent_map, child_map, tails_to_remove):
2319
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2320
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2321
        This will remove the supplied revisions until no more children have 0
2322
        parents.
2323
2324
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2325
            be modified in place.
2326
        :param tails_to_remove: A list of tips that should be removed,
2327
            this list will be consumed
2328
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2329
            this dict will be modified
2330
        :return: None, parent_map will be modified in place.
2331
        """
2332
        while tails_to_remove:
2333
            next = tails_to_remove.pop()
2334
            parent_map.pop(next)
2335
            children = child_map.pop(next)
2336
            for child in children:
2337
                child_parents = parent_map[child]
2338
                child_parents.remove(next)
2339
                if len(child_parents) == 0:
2340
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2341
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2342
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2343
        """Return a dict of texts we are interested in.
2344
2345
        Note that the input is in key tuples, but the output is in plain
2346
        revision ids.
2347
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2348
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2349
        :return: A dict of {'revision_id':lines} as returned by
2350
            _PlanMergeBase.get_lines()
2351
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2352
        all_revision_keys = set(parent_map)
2353
        all_revision_keys.add(self.a_key)
2354
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2355
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2356
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2357
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2358
        return all_texts
2359
2360
    def _build_weave(self):
6670.4.3 by Jelmer Vernooij
Fix more imports.
2361
        from .bzr import weave
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2362
        self._weave = weave.Weave(weave_name='in_memory_weave',
2363
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2364
        parent_map = self._find_recursive_lcas()
2365
2366
        all_texts = self._get_interesting_texts(parent_map)
2367
2368
        # Note: Unfortunately, the order given by topo_sort will effect the
2369
        # ordering resolution in the output. Specifically, if you add A then B,
2370
        # then in the output text A lines will show up before B lines. And, of
2371
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2372
        # So we use merge_sort, and add a fake node on the tip.
2373
        # This ensures that left-hand parents will always be inserted into the
2374
        # weave before right-hand parents.
2375
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2376
        parent_map[tip_key] = (self.a_key, self.b_key)
2377
2378
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2379
                                                                  tip_key)):
2380
            if key == tip_key:
2381
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2382
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2383
            parent_keys = parent_map[key]
2384
            revision_id = key[-1]
2385
            parent_ids = [k[-1] for k in parent_keys]
2386
            self._weave.add_lines(revision_id, parent_ids,
2387
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2388
2389
    def plan_merge(self):
2390
        """Generate a 'plan' for merging the two revisions.
2391
2392
        This involves comparing their texts and determining the cause of
2393
        differences.  If text A has a line and text B does not, then either the
2394
        line was added to text A, or it was deleted from B.  Once the causes
2395
        are combined, they are written out in the format described in
2396
        VersionedFile.plan_merge
2397
        """
2398
        if self._head_key is not None: # There was a single head
2399
            if self._head_key == self.a_key:
2400
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2401
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2402
                if self._head_key != self.b_key:
2403
                    raise AssertionError('There was an invalid head: %s != %s'
2404
                                         % (self.b_key, self._head_key))
2405
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2406
            head_rev = self._head_key[-1]
2407
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2408
            return ((plan, line) for line in lines)
2409
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2410
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2411
2412
class _PlanLCAMerge(_PlanMergeBase):
2413
    """
3144.3.7 by Aaron Bentley
Update from review
2414
    This merge algorithm differs from _PlanMerge in that:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2415
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2416
    1. comparisons are done against LCAs only
2417
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2418
       another are marked as conflicts, by emitting the line as conflicted-a
2419
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2420
2421
    This is faster, and hopefully produces more useful output.
2422
    """
2423
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2424
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2425
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2426
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2427
        self.lcas = set()
2428
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2429
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2430
                self.lcas.add(lca)
2431
            else:
2432
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2433
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2434
            if _mod_revision.is_null(lca):
2435
                lca_lines = []
2436
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2437
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2438
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2439
                                                           lca_lines)
2440
            blocks = list(matcher.get_matching_blocks())
2441
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2442
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2443
                                                           lca_lines)
2444
            blocks = list(matcher.get_matching_blocks())
2445
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2446
3144.3.7 by Aaron Bentley
Update from review
2447
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2448
        """Determines the status unique lines versus all lcas.
2449
2450
        Basically, determines why the line is unique to this revision.
2451
2452
        A line may be determined new, killed, or both.
2453
3144.3.7 by Aaron Bentley
Update from review
2454
        If a line is determined new, that means it was not present in at least
2455
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2456
2457
        If a line is determined killed, that means the line was present in
2458
        at least one LCA.
2459
2460
        If a line is killed and new, this indicates that the two merge
2461
        revisions contain differing conflict resolutions.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2462
3144.3.7 by Aaron Bentley
Update from review
2463
        :param revision_id: The id of the revision in which the lines are
2464
            unique
2465
        :param unique_line_numbers: The line numbers of unique lines.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2466
        :return: a tuple of (new_this, killed_other)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2467
        """
2468
        new = set()
2469
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2470
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2471
        for lca in self.lcas:
2472
            blocks = self._get_matching_blocks(revision_id, lca)
2473
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2474
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2475
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2476
        return new, killed