/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
6379.6.1 by Jelmer Vernooij
Import absolute_import in a few places.
17
from __future__ import absolute_import
18
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
19
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
20
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
21
from .lazy_import import lazy_import
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
22
lazy_import(globals(), """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
23
from breezy import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
25
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
26
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
27
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
28
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
29
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
30
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
31
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
32
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
33
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
34
    textfile,
35
    trace,
36
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
37
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
38
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
39
    ui,
6670.4.3 by Jelmer Vernooij
Fix more imports.
40
    workingtree,
41
    )
42
from breezy.bzr import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
43
    versionedfile,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
44
    )
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
45
from breezy.i18n import gettext
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
46
""")
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
47
from . import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
48
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
49
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
50
    hooks,
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
51
    registry,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
52
    )
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
53
from .sixish import (
54
    viewitems,
55
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
56
# TODO: Report back as changes are merged in
57
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
58
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
59
def transform_tree(from_tree, to_tree, interesting_files=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
60
    from_tree.lock_tree_write()
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
61
    operation = cleanup.OperationWithCleanups(merge_inner)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
62
    operation.add_cleanup(from_tree.unlock)
63
    operation.run_simple(from_tree.branch, to_tree, from_tree,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
64
        ignore_zero=True, this_tree=from_tree,
65
        interesting_files=interesting_files)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
66
1457.1.12 by Robert Collins
Update comment to reflect author.
67
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
68
class MergeHooks(hooks.Hooks):
69
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
70
    def __init__(self):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
71
        hooks.Hooks.__init__(self, "breezy.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
72
        self.add_hook('merge_file_content',
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
73
            "Called with a breezy.merge.Merger object to create a per file "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
74
            "merge object when starting a merge. "
75
            "Should return either None or a subclass of "
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
76
            "``breezy.merge.AbstractPerFileMerger``. "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
77
            "Such objects will then be called per file "
78
            "that needs to be merged (including when one "
79
            "side has deleted the file and the other has changed it). "
80
            "See the AbstractPerFileMerger API docs for details on how it is "
81
            "used by merge.",
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
82
            (2, 1))
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
83
        self.add_hook('pre_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
84
            'Called before a merge. '
85
            'Receives a Merger object as the single argument.',
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
86
            (2, 5))
87
        self.add_hook('post_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
88
            'Called after a merge. '
89
            'Receives a Merger object as the single argument. '
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
90
            'The return value is ignored.',
91
            (2, 5))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
92
93
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
94
class AbstractPerFileMerger(object):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
95
    """PerFileMerger objects are used by plugins extending merge for breezy.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
96
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
97
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
98
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
99
    :ivar merger: The Merge3Merger performing the merge.
100
    """
101
102
    def __init__(self, merger):
103
        """Create a PerFileMerger for use with merger."""
104
        self.merger = merger
105
106
    def merge_contents(self, merge_params):
107
        """Attempt to merge the contents of a single file.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
108
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
109
        :param merge_params: A breezy.merge.MergeFileHookParams
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
110
        :return: A tuple of (status, chunks), where status is one of
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
111
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
112
            is 'success' or 'conflicted', then chunks should be an iterable of
113
            strings for the new file contents.
114
        """
115
        return ('not applicable', None)
116
117
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
118
class PerFileMerger(AbstractPerFileMerger):
119
    """Merge individual files when self.file_matches returns True.
120
121
    This class is intended to be subclassed.  The file_matches and
122
    merge_matching methods should be overridden with concrete implementations.
123
    """
124
125
    def file_matches(self, params):
126
        """Return True if merge_matching should be called on this file.
127
128
        Only called with merges of plain files with no clear winner.
129
130
        Subclasses must override this.
131
        """
132
        raise NotImplementedError(self.file_matches)
133
134
    def merge_contents(self, params):
135
        """Merge the contents of a single file."""
136
        # Check whether this custom merge logic should be used.
137
        if (
138
            # OTHER is a straight winner, rely on default merge.
139
            params.winner == 'other' or
140
            # THIS and OTHER aren't both files.
141
            not params.is_file_merge() or
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
142
            # The filename doesn't match
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
143
            not self.file_matches(params)):
144
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
145
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
146
147
    def merge_matching(self, params):
148
        """Merge the contents of a single file that has matched the criteria
149
        in PerFileMerger.merge_contents (is a conflict, is a file,
150
        self.file_matches is True).
151
152
        Subclasses must override this.
153
        """
154
        raise NotImplementedError(self.merge_matching)
155
156
157
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
158
    """Merge individual files when configured via a .conf file.
159
160
    This is a base class for concrete custom file merging logic. Concrete
161
    classes should implement ``merge_text``.
162
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
163
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
164
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
165
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
166
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
167
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
168
        details. <name_prefix>_merge_files describes the files targeted by the
169
        hook for example.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
170
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
171
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
172
        is present.
173
    """
174
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
175
    name_prefix = None
176
    default_files = None
177
178
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
179
        super(ConfigurableFileMerger, self).__init__(merger)
180
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
181
        self.default_files = self.__class__.default_files or []
182
        self.name_prefix = self.__class__.name_prefix
183
        if self.name_prefix is None:
184
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
185
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
186
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
187
        """Check whether the file should call the merge hook.
188
189
        <name_prefix>_merge_files configuration variable is a list of files
190
        that should use the hook.
191
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
192
        affected_files = self.affected_files
193
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
194
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
195
            # Until bzr provides a better policy for caching the config, we
196
            # just add the part we're interested in to the params to avoid
6740.1.1 by Jelmer Vernooij
Rename bazaar.conf to breezy.conf.
197
            # reading the config files repeatedly (breezy.conf, location.conf,
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
198
            # branch.conf).
199
            config_key = self.name_prefix + '_merge_files'
200
            affected_files = config.get_user_option_as_list(config_key)
201
            if affected_files is None:
202
                # If nothing was specified in the config, use the default.
203
                affected_files = self.default_files
204
            self.affected_files = affected_files
205
        if affected_files:
6883.10.1 by Jelmer Vernooij
Fix more tets.
206
            filepath = params.this_path
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
207
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
208
                return True
209
        return False
210
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
211
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
212
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
213
214
    def merge_text(self, params):
215
        """Merge the byte contents of a single file.
216
217
        This is called after checking that the merge should be performed in
218
        merge_contents, and it should behave as per
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
219
        ``breezy.merge.AbstractPerFileMerger.merge_contents``.
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
220
        """
221
        raise NotImplementedError(self.merge_text)
222
223
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
224
class MergeFileHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
225
    """Object holding parameters passed to merge_file_content hooks.
226
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
227
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
228
229
    :ivar file_id: the file ID of the file being merged
6883.10.1 by Jelmer Vernooij
Fix more tets.
230
    :ivar base_path: Path in base tree
231
    :ivar other_path: Path in other tree
232
    :ivar this_path: Path in this tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
233
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
234
    :ivar this_kind: kind of file_id in 'this' tree
235
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
236
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
237
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
238
6883.10.1 by Jelmer Vernooij
Fix more tets.
239
    def __init__(self, merger, file_id, paths, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
240
            winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
241
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
242
        self.file_id = file_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
243
        self.paths = paths
244
        self.base_path, self.other_path, self.this_path = paths
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
245
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
246
        self.this_kind = this_kind
247
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
248
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
249
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
250
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
251
        """True if this_kind and other_kind are both 'file'."""
252
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
253
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
254
    @decorators.cachedproperty
255
    def base_lines(self):
256
        """The lines of the 'base' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
257
        return self._merger.get_lines(self._merger.base_tree, self.base_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
258
259
    @decorators.cachedproperty
260
    def this_lines(self):
261
        """The lines of the 'this' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
262
        return self._merger.get_lines(self._merger.this_tree, self.this_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
263
264
    @decorators.cachedproperty
265
    def other_lines(self):
266
        """The lines of the 'other' version of the file."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
267
        return self._merger.get_lines(self._merger.other_tree, self.other_path, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
268
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
269
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
270
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
271
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
272
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
273
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
274
    def __init__(self, this_branch, other_tree=None, base_tree=None,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
275
                 this_tree=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
276
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
277
        object.__init__(self)
278
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
279
        self.this_basis = _mod_revision.ensure_null(
280
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
281
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
282
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
283
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
284
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
285
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
286
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
287
        self.base_tree = base_tree
288
        self.ignore_zero = False
289
        self.backup_files = False
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
290
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
291
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
292
        self.reprocess = False
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
293
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
294
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
295
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
296
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
297
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
298
        self._base_is_ancestor = None
299
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
300
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
301
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
302
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
303
    def cache_trees_with_revision_ids(self, trees):
304
        """Cache any tree in trees if it has a revision_id."""
305
        for maybe_tree in trees:
306
            if maybe_tree is None:
307
                continue
308
            try:
309
                rev_id = maybe_tree.get_revision_id()
310
            except AttributeError:
311
                continue
312
            self._cached_trees[rev_id] = maybe_tree
313
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
314
    @property
315
    def revision_graph(self):
316
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
317
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
318
        return self._revision_graph
319
320
    def _set_base_is_ancestor(self, value):
321
        self._base_is_ancestor = value
322
323
    def _get_base_is_ancestor(self):
324
        if self._base_is_ancestor is None:
325
            self._base_is_ancestor = self.revision_graph.is_ancestor(
326
                self.base_rev_id, self.this_basis)
327
        return self._base_is_ancestor
328
329
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
330
331
    def _set_base_is_other_ancestor(self, value):
332
        self._base_is_other_ancestor = value
333
334
    def _get_base_is_other_ancestor(self):
335
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
336
            if self.other_basis is None:
337
                return True
338
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
339
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
340
        return self._base_is_other_ancestor
341
342
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
343
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
344
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
345
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
346
    def from_uncommitted(tree, other_tree, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
347
        """Return a Merger for uncommitted changes in other_tree.
348
349
        :param tree: The tree to merge into
350
        :param other_tree: The tree to get uncommitted changes from
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
351
        :param base_tree: The basis to use for the merge.  If unspecified,
352
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
353
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
354
        if base_tree is None:
355
            base_tree = other_tree.basis_tree()
6719.1.2 by Jelmer Vernooij
Fix some tests.
356
        merger = Merger(tree.branch, other_tree, base_tree, tree)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
357
        merger.base_rev_id = merger.base_tree.get_revision_id()
358
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
359
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
360
        return merger
361
362
    @classmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
363
    def from_mergeable(klass, tree, mergeable):
1551.15.74 by Aaron Bentley
Textual updates from review
364
        """Return a Merger for a bundle or merge directive.
365
366
        :param tree: The tree to merge changes into
367
        :param mergeable: A merge directive or bundle
368
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
369
        mergeable.install_revisions(tree.branch.repository)
370
        base_revision_id, other_revision_id, verified =\
371
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
372
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
373
        if base_revision_id is not None:
374
            if (base_revision_id != _mod_revision.NULL_REVISION and
375
                revision_graph.is_ancestor(
376
                base_revision_id, tree.branch.last_revision())):
377
                base_revision_id = None
378
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
379
                trace.warning('Performing cherrypick')
6719.1.2 by Jelmer Vernooij
Fix some tests.
380
        merger = klass.from_revision_ids(tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
381
                                         base_revision_id, revision_graph=
382
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
383
        return merger, verified
384
385
    @staticmethod
6719.1.2 by Jelmer Vernooij
Fix some tests.
386
    def from_revision_ids(tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
387
                          base_branch=None, revision_graph=None,
388
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
389
        """Return a Merger for revision-ids.
390
391
        :param tree: The tree to merge changes into
392
        :param other: The revision-id to use as OTHER
393
        :param base: The revision-id to use as BASE.  If not specified, will
394
            be auto-selected.
395
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
396
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
397
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
398
            not supplied, other_branch or tree.branch will be used.
399
        :param revision_graph: If you have a revision_graph precomputed, pass
400
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
401
        :param tree_branch: The branch associated with tree.  If not supplied,
402
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
403
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
404
        if tree_branch is None:
405
            tree_branch = tree.branch
6719.1.2 by Jelmer Vernooij
Fix some tests.
406
        merger = Merger(tree_branch, this_tree=tree,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
407
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
408
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
409
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
410
        merger.set_other_revision(other, other_branch)
411
        if base is None:
412
            merger.find_base()
413
        else:
414
            if base_branch is None:
415
                base_branch = other_branch
416
            merger.set_base_revision(base, base_branch)
417
        return merger
418
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
419
    def revision_tree(self, revision_id, branch=None):
420
        if revision_id not in self._cached_trees:
421
            if branch is None:
422
                branch = self.this_branch
423
            try:
424
                tree = self.this_tree.revision_tree(revision_id)
425
            except errors.NoSuchRevisionInTree:
426
                tree = branch.repository.revision_tree(revision_id)
427
            self._cached_trees[revision_id] = tree
428
        return self._cached_trees[revision_id]
429
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
430
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
431
        location, revno = treespec
432
        if revno is None:
433
            tree = workingtree.WorkingTree.open_containing(location)[0]
434
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
435
        branch = _mod_branch.Branch.open_containing(
436
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
437
        if revno == -1:
438
            revision_id = branch.last_revision()
439
        else:
440
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
441
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
442
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
443
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
444
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
445
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
446
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
447
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
448
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
449
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
450
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
451
        self._add_parent()
452
453
    def _add_parent(self):
454
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
455
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
456
        operation = cleanup.OperationWithCleanups(
457
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
458
        for revision_id in new_parents:
459
            try:
460
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
461
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
462
                tree = None
463
            else:
464
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
465
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
466
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
467
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
468
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
469
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
470
        """Set the revision and tree to merge from.
471
472
        This sets the other_tree, other_rev_id, other_basis attributes.
473
474
        :param other_revision: The [path, revision] list to merge from.
475
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
476
        self.other_branch, self.other_tree = self._get_tree(other_revision,
477
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
478
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
479
            self.other_rev_id = _mod_revision.ensure_null(
480
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
481
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
482
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
483
            self.other_basis = self.other_rev_id
484
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
485
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
486
            self.other_basis = self.other_rev_id
487
        else:
488
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
489
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
490
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
491
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
492
        if self.other_rev_id is not None:
493
            self._cached_trees[self.other_rev_id] = self.other_tree
6388.1.2 by Jelmer Vernooij
Fix formatting.
494
        self._maybe_fetch(self.other_branch, self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
495
2100.3.29 by Aaron Bentley
Get merge working initially
496
    def set_other_revision(self, revision_id, other_branch):
497
        """Set 'other' based on a branch and revision id
498
499
        :param revision_id: The revision to use for a tree
500
        :param other_branch: The branch containing this tree
501
        """
502
        self.other_rev_id = revision_id
503
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
504
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
505
        self.other_tree = self.revision_tree(revision_id)
506
        self.other_basis = revision_id
507
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
508
    def set_base_revision(self, revision_id, branch):
509
        """Set 'base' based on a branch and revision id
510
511
        :param revision_id: The revision to use for a tree
512
        :param branch: The branch containing this tree
513
        """
514
        self.base_rev_id = revision_id
515
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
516
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
517
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
518
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
519
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
520
        if not source.repository.has_same_location(target.repository):
5741.1.9 by Jelmer Vernooij
Remove fetch_tags argument.
521
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
522
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
523
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
524
        revisions = [_mod_revision.ensure_null(self.this_basis),
525
                     _mod_revision.ensure_null(self.other_basis)]
526
        if _mod_revision.NULL_REVISION in revisions:
527
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
528
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
529
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
530
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
531
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
532
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
533
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
534
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
535
            elif len(lcas) == 1:
536
                self.base_rev_id = list(lcas)[0]
537
            else: # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
538
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
539
                if len(lcas) > 2:
540
                    # find_unique_lca can only handle 2 nodes, so we have to
541
                    # start back at the beginning. It is a shame to traverse
542
                    # the graph again, but better than re-implementing
543
                    # find_unique_lca.
544
                    self.base_rev_id = self.revision_graph.find_unique_lca(
545
                                            revisions[0], revisions[1])
546
                else:
547
                    self.base_rev_id = self.revision_graph.find_unique_lca(
548
                                            *lcas)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
549
                sorted_lca_keys = self.revision_graph.find_merge_order(
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
550
                    revisions[0], lcas)
551
                if self.base_rev_id == _mod_revision.NULL_REVISION:
552
                    self.base_rev_id = sorted_lca_keys[0]
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
553
4721.3.1 by Vincent Ladeuil
Cleanup imports.
554
            if self.base_rev_id == _mod_revision.NULL_REVISION:
555
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
556
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
557
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
558
                              ' help criss-cross.')
559
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
560
                if self.base_rev_id in lcas:
561
                    trace.mutter('Unable to find unique lca. '
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
562
                                 'Fallback %r as best option.'
563
                                 % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
564
                interesting_revision_ids = set(lcas)
565
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
566
                interesting_trees = dict((t.get_revision_id(), t)
567
                    for t in self.this_branch.repository.revision_trees(
568
                        interesting_revision_ids))
569
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
570
                if self.base_rev_id in lcas:
571
                    self.base_tree = interesting_trees[self.base_rev_id]
572
                else:
573
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
574
                self._lca_trees = [interesting_trees[key]
575
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
576
            else:
577
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
578
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
579
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
580
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
581
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
582
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
583
        """Set the base revision to use for the merge.
584
585
        :param base_revision: A 2-list containing a path and revision number.
586
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
587
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
588
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
589
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
590
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
591
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
592
            if base_revision[1] == -1:
593
                self.base_rev_id = base_branch.last_revision()
594
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
595
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
596
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
597
                self.base_rev_id = _mod_revision.ensure_null(
598
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
599
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
600
3008.1.8 by Michael Hudson
extract merger creation into a method
601
    def make_merger(self):
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
602
        kwargs = {'working_tree': self.this_tree, 'this_tree': self.this_tree,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
603
                  'other_tree': self.other_tree,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
604
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
605
                  'this_branch': self.this_branch,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
606
                  'other_branch': self.other_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
607
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
608
        if self.merge_type.requires_base:
609
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
610
        if self.merge_type.supports_reprocess:
611
            kwargs['reprocess'] = self.reprocess
612
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
613
            raise errors.BzrError(
614
                "Conflict reduction is not supported for merge"
615
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
616
        if self.merge_type.supports_show_base:
617
            kwargs['show_base'] = self.show_base
618
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
619
            raise errors.BzrError("Showing base is not supported for this"
620
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
621
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
622
            and not self.base_is_other_ancestor):
623
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
624
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
625
            kwargs['cherrypick'] = (not self.base_is_ancestor or
626
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
627
        if self._is_criss_cross and getattr(self.merge_type,
628
                                            'supports_lca_trees', False):
629
            kwargs['lca_trees'] = self._lca_trees
6719.1.2 by Jelmer Vernooij
Fix some tests.
630
        return self.merge_type(change_reporter=self.change_reporter,
3008.1.8 by Michael Hudson
extract merger creation into a method
631
                               **kwargs)
632
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
633
    def _do_merge_to(self):
634
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
635
        if self.other_branch is not None:
636
            self.other_branch.update_references(self.this_branch)
6388.1.4 by Jelmer Vernooij
Fix tests.
637
        for hook in Merger.hooks['pre_merge']:
638
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
639
        merge.do_merge()
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
640
        for hook in Merger.hooks['post_merge']:
641
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
642
        if self.recurse == 'down':
643
            for relpath, file_id in self.this_tree.iter_references():
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
644
                sub_tree = self.this_tree.get_nested_tree(relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
645
                other_revision = self.other_tree.get_reference_revision(
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
646
                    relpath, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
647
                if  other_revision == sub_tree.last_revision():
648
                    continue
649
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
650
                sub_merge.merge_type = self.merge_type
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
651
                other_branch = self.other_branch.reference_parent(file_id,
652
                                                                  relpath)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
653
                sub_merge.set_other_revision(other_revision, other_branch)
6883.5.3 by Jelmer Vernooij
Add find_previous_path.
654
                base_tree_path = _mod_tree.find_previous_path(
655
                    self.this_tree, self.base_tree, relpath)
6809.4.1 by Jelmer Vernooij
Swap file_id and path arguments for get_reference_revision and get_nested_tree.
656
                base_revision = self.base_tree.get_reference_revision(
657
                    base_tree_path, file_id)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
658
                sub_merge.base_tree = \
659
                    sub_tree.branch.repository.revision_tree(base_revision)
660
                sub_merge.base_rev_id = base_revision
661
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
662
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
663
3008.1.8 by Michael Hudson
extract merger creation into a method
664
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
665
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
666
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
667
        operation.add_cleanup(self.this_tree.unlock)
668
        if self.base_tree is not None:
669
            self.base_tree.lock_read()
670
            operation.add_cleanup(self.base_tree.unlock)
671
        if self.other_tree is not None:
672
            self.other_tree.lock_read()
673
            operation.add_cleanup(self.other_tree.unlock)
674
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
675
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
676
            if not self.ignore_zero and not trace.is_quiet():
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
677
                trace.note(gettext("All changes applied successfully."))
1534.7.141 by Aaron Bentley
Added conflict reporting
678
        else:
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
679
            trace.note(gettext("%d conflicts encountered.")
4721.3.1 by Vincent Ladeuil
Cleanup imports.
680
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
681
1534.7.134 by Aaron Bentley
Hid raw conflicts
682
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
683
1545.2.4 by Aaron Bentley
PEP8 fixes
684
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
685
class _InventoryNoneEntry(object):
686
    """This represents an inventory entry which *isn't there*.
687
688
    It simplifies the merging logic if we always have an InventoryEntry, even
689
    if it isn't actually present
690
    """
691
    executable = None
692
    kind = None
693
    name = None
694
    parent_id = None
695
    revision = None
696
    symlink_target = None
697
    text_sha1 = None
698
699
_none_entry = _InventoryNoneEntry()
700
701
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
702
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
703
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
704
    requires_base = True
705
    supports_reprocess = True
706
    supports_show_base = True
707
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
708
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
709
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
710
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
711
    supports_lca_trees = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
712
    requires_file_merge_plan = False
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
713
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
714
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
715
                 reprocess=False, show_base=False,
6719.1.1 by Jelmer Vernooij
Remove some more deprecated stuff.
716
                 change_reporter=None, interesting_files=None, do_merge=True,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
717
                 cherrypick=False, lca_trees=None, this_branch=None,
718
                 other_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
719
        """Initialize the merger object and perform the merge.
720
721
        :param working_tree: The working tree to apply the merge to
722
        :param this_tree: The local tree in the merge operation
723
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
724
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
725
        :param this_branch: The branch associated with this_tree.  Defaults to
726
            this_tree.branch if not supplied.
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
727
        :param other_branch: The branch associated with other_tree, if any.
2590.2.10 by Aaron Bentley
Updates from review
728
        :param: reprocess If True, perform conflict-reduction processing.
729
        :param show_base: If True, show the base revision in text conflicts.
730
            (incompatible with reprocess)
731
        :param change_reporter: An object that should report changes made
732
        :param interesting_files: The tree-relative paths of files that should
733
            participate in the merge.  If these paths refer to directories,
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
734
            the contents of those directories will also be included.  If not
735
            specified, all files may participate in the
2590.2.10 by Aaron Bentley
Updates from review
736
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
737
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
738
            if the ancestry was found to include a criss-cross merge.
739
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
740
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
741
        object.__init__(self)
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
742
        if this_branch is None:
743
            this_branch = this_tree.branch
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
744
        self.interesting_files = interesting_files
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
745
        self.working_tree = working_tree
746
        self.this_tree = this_tree
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
747
        self.base_tree = base_tree
748
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
749
        self.this_branch = this_branch
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
750
        self.other_branch = other_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
751
        self._raw_conflicts = []
752
        self.cooked_conflicts = []
753
        self.reprocess = reprocess
754
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
755
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
756
        # Uncommenting this will change the default algorithm to always use
757
        # _entries_lca. This can be useful for running the test suite and
758
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
759
        # if lca_trees is None:
760
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
761
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
762
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
763
        if do_merge:
764
            self.do_merge()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
765
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
766
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
767
        operation = cleanup.OperationWithCleanups(self._do_merge)
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
768
        self.working_tree.lock_tree_write()
769
        operation.add_cleanup(self.working_tree.unlock)
770
        self.this_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
771
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
772
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
773
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
774
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
775
        operation.add_cleanup(self.other_tree.unlock)
776
        operation.run()
777
778
    def _do_merge(self, operation):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
779
        self.tt = transform.TreeTransform(self.working_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
780
        operation.add_cleanup(self.tt.finalize)
781
        self._compute_transform()
782
        results = self.tt.apply(no_conflicts=True)
783
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
784
        try:
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
785
            self.working_tree.add_conflicts(self.cooked_conflicts)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
786
        except errors.UnsupportedOperation:
787
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
788
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
789
    def make_preview_transform(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
790
        operation = cleanup.OperationWithCleanups(self._make_preview_transform)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
791
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
792
        operation.add_cleanup(self.base_tree.unlock)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
793
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
794
        operation.add_cleanup(self.other_tree.unlock)
795
        return operation.run_simple()
796
797
    def _make_preview_transform(self):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
798
        self.tt = transform.TransformPreview(self.working_tree)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
799
        self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
800
        return self.tt
801
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
802
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
803
        if self._lca_trees is None:
804
            entries = self._entries3()
805
            resolver = self._three_way
806
        else:
807
            entries = self._entries_lca()
808
            resolver = self._lca_multi_way
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
809
        # Prepare merge hooks
810
        factories = Merger.hooks['merge_file_content']
811
        # One hook for each registered one plus our default merger
812
        hooks = [factory(self) for factory in factories] + [self]
813
        self.active_hooks = [hook for hook in hooks if hook is not None]
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
814
        with ui.ui_factory.nested_progress_bar() as child_pb:
6883.10.1 by Jelmer Vernooij
Fix more tets.
815
            for num, (file_id, changed, paths3, parents3, names3,
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
816
                      executable3) in enumerate(entries):
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
817
                # Try merging each entry
818
                child_pb.update(gettext('Preparing file merge'),
819
                                num, len(entries))
6883.10.1 by Jelmer Vernooij
Fix more tets.
820
                self._merge_names(file_id, paths3, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
821
                if changed:
6883.10.1 by Jelmer Vernooij
Fix more tets.
822
                    file_status = self._do_merge_contents(paths3, file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
823
                else:
824
                    file_status = 'unmodified'
6883.10.1 by Jelmer Vernooij
Fix more tets.
825
                self._merge_executable(paths3, file_id, executable3,
826
                        file_status, resolver=resolver)
5993.2.4 by Jelmer Vernooij
Remove feature flag.
827
        self.tt.fixup_new_roots()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
828
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
829
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
830
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
831
        """Finalize the transform and report the changes.
832
833
        This is the second half of _compute_transform.
834
        """
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
835
        with ui.ui_factory.nested_progress_bar() as child_pb:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
836
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
837
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
838
        if self.change_reporter is not None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
839
            from breezy import delta
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
840
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
841
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
842
        self.cook_conflicts(fs_conflicts)
843
        for conflict in self.cooked_conflicts:
5898.1.6 by Martin
Avoid implicit str casting in trace methods by calling unicode() on conflict objects first
844
            trace.warning(unicode(conflict))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
845
2590.2.4 by Aaron Bentley
Move entry generation to a helper
846
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
847
        """Gather data about files modified between three trees.
848
849
        Return a list of tuples of file_id, changed, parents3, names3,
850
        executable3.  changed is a boolean indicating whether the file contents
851
        or kind were changed.  parents3 is a tuple of parent ids for base,
852
        other and this.  names3 is a tuple of names for base, other and this.
853
        executable3 is a tuple of execute-bit values for base, other and this.
854
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
855
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
856
        iterator = self.other_tree.iter_changes(self.base_tree,
5783.2.1 by John Arbash Meinel
Remove the 'include_unchanged=True' from iter_changes.
857
                specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
858
                extra_trees=[self.this_tree])
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
859
        this_interesting_files = self.this_tree.find_related_paths_across_trees(
860
                self.interesting_files, trees=[self.other_tree])
6883.10.1 by Jelmer Vernooij
Fix more tets.
861
        this_entries = dict(self.this_tree.iter_entries_by_dir(
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
862
                            specific_files=this_interesting_files))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
863
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
864
             executable) in iterator:
6883.10.2 by Jelmer Vernooij
Resolve TODO
865
            if paths[0] is not None:
866
                this_path = _mod_tree.find_previous_path(
867
                        self.base_tree, self.this_tree, paths[0])
6883.10.1 by Jelmer Vernooij
Fix more tets.
868
            else:
6883.10.2 by Jelmer Vernooij
Resolve TODO
869
                this_path = _mod_tree.find_previous_path(
870
                        self.other_tree, self.this_tree, paths[1])
871
            this_entry = this_entries.get(this_path)
6883.10.1 by Jelmer Vernooij
Fix more tets.
872
            if this_entry is not None:
873
                this_name = this_entry.name
874
                this_parent = this_entry.parent_id
875
                this_executable = this_entry.executable
2590.2.4 by Aaron Bentley
Move entry generation to a helper
876
            else:
877
                this_name = None
878
                this_parent = None
879
                this_executable = None
880
            parents3 = parents + (this_parent,)
881
            names3 = names + (this_name,)
6883.10.1 by Jelmer Vernooij
Fix more tets.
882
            paths3 = paths + (this_path, )
2590.2.4 by Aaron Bentley
Move entry generation to a helper
883
            executable3 = executable + (this_executable,)
6883.10.1 by Jelmer Vernooij
Fix more tets.
884
            result.append((file_id, changed, paths3, parents3, names3, executable3))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
885
        return result
886
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
887
    def _entries_lca(self):
888
        """Gather data about files modified between multiple trees.
889
890
        This compares OTHER versus all LCA trees, and for interesting entries,
891
        it then compares with THIS and BASE.
892
893
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
894
6883.10.1 by Jelmer Vernooij
Fix more tets.
895
        :return: [(file_id, changed, paths, parents, names, executable)], where:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
896
897
            * file_id: Simple file_id of the entry
898
            * changed: Boolean, True if the kind or contents changed else False
6883.10.1 by Jelmer Vernooij
Fix more tets.
899
            * paths: ((base, [path, in, lcas]), path_other, path_this)
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
900
            * parents: ((base, [parent_id, in, lcas]), parent_id_other,
901
                        parent_id_this)
902
            * names:   ((base, [name, in, lcas]), name_in_other, name_in_this)
903
            * executable: ((base, [exec, in, lcas]), exec_in_other,
904
                        exec_in_this)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
905
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
906
        if self.interesting_files is not None:
907
            lookup_trees = [self.this_tree, self.base_tree]
908
            lookup_trees.extend(self._lca_trees)
909
            # I think we should include the lca trees as well
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
910
            interesting_files = self.other_tree.find_related_paths_across_trees(
911
                    self.interesting_files, lookup_trees)
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
912
        else:
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
913
            interesting_files = None
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
914
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
915
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
916
6405.2.10 by Jelmer Vernooij
Fix more tests.
917
        base_inventory = self.base_tree.root_inventory
918
        this_inventory = self.this_tree.root_inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
919
        for path, file_id, other_ie, lca_values in walker.iter_all():
920
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
921
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
922
                other_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
923
                other_path = None
924
            else:
925
                other_path = self.other_tree.id2path(file_id)
6883.10.3 by Jelmer Vernooij
Merge trunk.
926
            if interesting_files is not None and other_path not in interesting_files:
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
927
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
928
3514.4.30 by John Arbash Meinel
Several updates.
929
            # If other_revision is found in any of the lcas, that means this
930
            # node is uninteresting. This is because when merging, if there are
931
            # multiple heads(), we have to create a new node. So if we didn't,
932
            # we know that the ancestry is linear, and that OTHER did not
933
            # modify anything
934
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
935
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
936
            if other_revision is not None:
937
                # We can't use this shortcut when other_revision is None,
938
                # because it may be None because things are WorkingTrees, and
939
                # not because it is *actually* None.
940
                is_unmodified = False
941
                for lca_path, ie in lca_values:
942
                    if ie is not None and ie.revision == other_revision:
943
                        is_unmodified = True
944
                        break
945
                if is_unmodified:
946
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
947
948
            lca_entries = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
949
            lca_paths = []
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
950
            for lca_path, lca_ie in lca_values:
951
                if lca_ie is None:
952
                    lca_entries.append(_none_entry)
6883.10.1 by Jelmer Vernooij
Fix more tets.
953
                    lca_paths.append(None)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
954
                else:
955
                    lca_entries.append(lca_ie)
6883.10.1 by Jelmer Vernooij
Fix more tets.
956
                    lca_paths.append(path)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
957
6883.7.12 by Jelmer Vernooij
avoid has_id.
958
            try:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
959
                base_ie = base_inventory[file_id]
6883.7.12 by Jelmer Vernooij
avoid has_id.
960
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
961
                base_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
962
                base_path = None
963
            else:
964
                base_path = self.base_tree.id2path(file_id)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
965
6883.7.12 by Jelmer Vernooij
avoid has_id.
966
            try:
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
967
                this_ie = this_inventory[file_id]
6883.7.12 by Jelmer Vernooij
avoid has_id.
968
            except errors.NoSuchId:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
969
                this_ie = _none_entry
6883.10.1 by Jelmer Vernooij
Fix more tets.
970
                this_path = None
971
            else:
972
                this_path = self.this_tree.id2path(file_id)
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
973
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
974
            lca_kinds = []
975
            lca_parent_ids = []
976
            lca_names = []
977
            lca_executable = []
978
            for lca_ie in lca_entries:
979
                lca_kinds.append(lca_ie.kind)
980
                lca_parent_ids.append(lca_ie.parent_id)
981
                lca_names.append(lca_ie.name)
982
                lca_executable.append(lca_ie.executable)
983
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
984
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
985
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
986
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
987
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
988
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
989
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
990
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
991
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
992
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
993
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
994
            content_changed = True
995
            if kind_winner == 'this':
996
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
997
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
998
                    if parent_id_winner == 'this' and name_winner == 'this':
999
                        # No change for this directory in OTHER, skip
1000
                        continue
1001
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1002
                elif other_ie.kind is None or other_ie.kind == 'file':
6883.10.1 by Jelmer Vernooij
Fix more tets.
1003
                    def get_sha1(tree, path):
1004
                        if path is None:
1005
                            return None
1006
                        try:
1007
                            return tree.get_file_sha1(path, file_id)
1008
                        except errors.NoSuchFile:
1009
                            return None
1010
                    base_sha1 = get_sha1(self.base_tree, base_path)
1011
                    lca_sha1s = [get_sha1(tree, lca_path) for tree, lca_path
1012
                                 in zip(self._lca_trees, lca_paths)]
1013
                    this_sha1 = get_sha1(self.this_tree, this_path)
1014
                    other_sha1 = get_sha1(self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1015
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1016
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1017
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1018
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1019
                        (base_ie.executable, lca_executable),
1020
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1021
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1022
                        and sha1_winner == 'this' and exec_winner == 'this'):
1023
                        # No kind, parent, name, exec, or content change for
1024
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1025
                        continue
1026
                    if sha1_winner == 'this':
1027
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1028
                elif other_ie.kind == 'symlink':
6883.10.1 by Jelmer Vernooij
Fix more tets.
1029
                    def get_target(ie, tree, path):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1030
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1031
                            return None
6809.4.21 by Jelmer Vernooij
Fix long lines.
1032
                        return tree.get_symlink_target(path, file_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1033
                    base_target = get_target(base_ie, self.base_tree, base_path)
1034
                    lca_targets = [get_target(ie, tree, lca_path) for ie, tree, lca_path
1035
                                   in zip(lca_entries, self._lca_trees, lca_paths)]
1036
                    this_target = get_target(this_ie, self.this_tree, this_path)
1037
                    other_target = get_target(other_ie, self.other_tree, other_path)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1038
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1039
                        (base_target, lca_targets),
1040
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1041
                    if (parent_id_winner == 'this' and name_winner == 'this'
1042
                        and target_winner == 'this'):
1043
                        # No kind, parent, name, or symlink target change
1044
                        # not interesting
1045
                        continue
1046
                    if target_winner == 'this':
1047
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1048
                elif other_ie.kind == 'tree-reference':
1049
                    # The 'changed' information seems to be handled at a higher
1050
                    # level. At least, _entries3 returns False for content
1051
                    # changed, even when at a new revision_id.
1052
                    content_changed = False
1053
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1054
                        # Nothing interesting
1055
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1056
                else:
1057
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1058
1059
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1060
            result.append((file_id, content_changed,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1061
                           ((base_path, lca_paths),
1062
                            other_path, this_path),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1063
                           ((base_ie.parent_id, lca_parent_ids),
1064
                            other_ie.parent_id, this_ie.parent_id),
1065
                           ((base_ie.name, lca_names),
1066
                            other_ie.name, this_ie.name),
1067
                           ((base_ie.executable, lca_executable),
1068
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1069
                          ))
1070
        return result
1071
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1072
    def write_modified(self, results):
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1073
        if not self.working_tree.supports_merge_modified():
1074
            return
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1075
        modified_hashes = {}
1076
        for path in results.modified_paths:
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1077
            wt_relpath = self.working_tree.relpath(path)
1078
            file_id = self.working_tree.path2id(wt_relpath)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1079
            if file_id is None:
1080
                continue
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1081
            hash = self.working_tree.get_file_sha1(wt_relpath, file_id)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1082
            if hash is None:
1083
                continue
1084
            modified_hashes[file_id] = hash
6885.2.1 by Jelmer Vernooij
Add WorkingTree.supports_merge_modified.
1085
        self.working_tree.set_merge_modified(modified_hashes)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1086
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1087
    @staticmethod
1088
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1089
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1090
        if entry is None:
1091
            return None
1092
        return entry.parent_id
1093
1094
    @staticmethod
1095
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1096
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1097
        if entry is None:
1098
            return None
1099
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1100
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1101
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1102
    def contents_sha1(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1103
        """Determine the sha1 of the file contents (used as a key method)."""
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1104
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1105
            return tree.get_file_sha1(path, file_id)
1106
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1107
            return None
1108
1109
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1110
    def executable(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1111
        """Determine the executability of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1112
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1113
            if tree.kind(path, file_id) != "file":
1114
                return False
1115
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1116
            return None
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1117
        return tree.is_executable(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1118
1119
    @staticmethod
6883.10.1 by Jelmer Vernooij
Fix more tets.
1120
    def kind(tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1121
        """Determine the kind of a file-id (used as a key method)."""
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1122
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1123
            return tree.kind(path, file_id)
1124
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1125
            return None
1126
1127
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1128
    def _three_way(base, other, this):
1129
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1130
            # if 'base == other', either they all agree, or only 'this' has
1131
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1132
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1133
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1134
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1135
            return 'conflict'
1136
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1137
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1138
            return "this"
1139
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1140
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1141
            return "other"
1142
1143
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1144
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1145
        """Consider LCAs when determining whether a change has occurred.
1146
1147
        If LCAS are all identical, this is the same as a _three_way comparison.
1148
1149
        :param bases: value in (BASE, [LCAS])
1150
        :param other: value in OTHER
1151
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1152
        :param allow_overriding_lca: If there is more than one unique lca
1153
            value, allow OTHER to override THIS if it has a new value, and
1154
            THIS only has an lca value, or vice versa. This is appropriate for
1155
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1156
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1157
            changed or not.
1158
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1159
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1160
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1161
        if other == this:
1162
            # Either Ambiguously clean, or nothing was actually changed. We
1163
            # don't really care
1164
            return 'this'
1165
        base_val, lca_vals = bases
1166
        # Remove 'base_val' from the lca_vals, because it is not interesting
1167
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1168
                                      if lca_val != base_val]
1169
        if len(filtered_lca_vals) == 0:
1170
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1171
1172
        unique_lca_vals = set(filtered_lca_vals)
1173
        if len(unique_lca_vals) == 1:
1174
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1175
1176
        if allow_overriding_lca:
1177
            if other in unique_lca_vals:
1178
                if this in unique_lca_vals:
1179
                    # Each side picked a different lca, conflict
1180
                    return 'conflict'
1181
                else:
1182
                    # This has a value which supersedes both lca values, and
1183
                    # other only has an lca value
1184
                    return 'this'
1185
            elif this in unique_lca_vals:
1186
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1187
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1188
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1189
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1190
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1191
        return 'conflict'
1192
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1193
    def merge_names(self, file_id):
1194
        def get_entry(tree):
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1195
            try:
6405.2.10 by Jelmer Vernooij
Fix more tests.
1196
                return tree.root_inventory[file_id]
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1197
            except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1198
                return None
1199
        this_entry = get_entry(self.this_tree)
1200
        other_entry = get_entry(self.other_tree)
1201
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1202
        entries = (base_entry, other_entry, this_entry)
1203
        names = []
1204
        parents = []
1205
        for entry in entries:
1206
            if entry is None:
1207
                names.append(None)
1208
                parents.append(None)
1209
            else:
1210
                names.append(entry.name)
1211
                parents.append(entry.parent_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1212
        return self._merge_names(file_id, paths, parents, names,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1213
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1214
6883.10.1 by Jelmer Vernooij
Fix more tets.
1215
    def _merge_names(self, file_id, paths, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1216
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1217
        base_name, other_name, this_name = names
1218
        base_parent, other_parent, this_parent = parents
6883.10.1 by Jelmer Vernooij
Fix more tets.
1219
        unused_base_path, other_path, this_path = paths
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1220
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1221
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1222
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1223
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1224
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1225
            if name_winner == "this":
1226
                name_winner = "other"
1227
            if parent_id_winner == "this":
1228
                parent_id_winner = "other"
1229
        if name_winner == "this" and parent_id_winner == "this":
1230
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1231
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1232
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1233
            # road if a ContentConflict needs to be created so we should not do
1234
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1235
            trans_id = self.tt.trans_id_file_id(file_id)
1236
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1237
                                        this_parent, this_name,
1238
                                        other_parent, other_name))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1239
        if other_path is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1240
            # it doesn't matter whether the result was 'other' or
5954.4.6 by Aaron Bentley
Updates from review.
1241
            # 'conflict'-- if it has no file id, we leave it alone.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1242
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1243
        parent_id = parents[self.winner_idx[parent_id_winner]]
5954.4.2 by Aaron Bentley
Support merging into null tree.
1244
        name = names[self.winner_idx[name_winner]]
1245
        if parent_id is not None or name is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1246
            # if we get here, name_winner and parent_winner are set to safe
1247
            # values.
5954.4.2 by Aaron Bentley
Support merging into null tree.
1248
            if parent_id is None and name is not None:
1249
                # if parent_id is None and name is non-None, current file is
1250
                # the tree root.
1251
                if names[self.winner_idx[parent_id_winner]] != '':
1252
                    raise AssertionError(
1253
                        'File looks like a root, but named %s' %
1254
                        names[self.winner_idx[parent_id_winner]])
1255
                parent_trans_id = transform.ROOT_PARENT
1256
            else:
1257
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1258
            self.tt.adjust_path(name, parent_trans_id,
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1259
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1260
6883.10.1 by Jelmer Vernooij
Fix more tets.
1261
    def _do_merge_contents(self, paths, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1262
        """Performs a merge on file_id contents."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1263
        def contents_pair(tree, path):
1264
            if path is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1265
                return (None, None)
6809.4.17 by Jelmer Vernooij
One more :)
1266
            try:
1267
                kind = tree.kind(path, file_id)
1268
            except errors.NoSuchFile:
1269
                return (None, None)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1270
            if kind == "file":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1271
                contents = tree.get_file_sha1(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1272
            elif kind == "symlink":
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1273
                contents = tree.get_symlink_target(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1274
            else:
1275
                contents = None
1276
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1277
6883.10.1 by Jelmer Vernooij
Fix more tets.
1278
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1279
        # See SPOT run.  run, SPOT, run.
1280
        # So we're not QUITE repeating ourselves; we do tricky things with
1281
        # file kind...
6883.10.1 by Jelmer Vernooij
Fix more tets.
1282
        other_pair = contents_pair(self.other_tree, other_path)
1283
        this_pair = contents_pair(self.this_tree, this_path)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1284
        if self._lca_trees:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1285
            (base_path, lca_paths) = base_path
1286
            base_pair = contents_pair(self.base_tree, base_path)
1287
            lca_pairs = [contents_pair(tree, path)
1288
                         for tree, path in zip(self._lca_trees, lca_paths)]
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1289
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1290
                                         this_pair, allow_overriding_lca=False)
1291
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1292
            base_pair = contents_pair(self.base_tree, base_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1293
            if base_pair == other_pair:
1294
                winner = 'this'
1295
            else:
1296
                # We delayed evaluating this_pair as long as we can to avoid
1297
                # unnecessary sha1 calculation
6883.10.1 by Jelmer Vernooij
Fix more tets.
1298
                this_pair = contents_pair(self.this_tree, this_path)
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1299
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1300
        if winner == 'this':
1301
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1302
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1303
        # We have a hypothetical conflict, but if we have files, then we
1304
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1305
        trans_id = self.tt.trans_id_file_id(file_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1306
        params = MergeFileHookParams(
1307
            self, file_id, (base_path, other_path,
1308
            this_path), trans_id, this_pair[0],
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1309
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1310
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1311
        hook_status = 'not_applicable'
1312
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1313
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1314
            if hook_status != 'not_applicable':
1315
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1316
                break
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1317
        # If the merge ends up replacing the content of the file, we get rid of
1318
        # it at the end of this method (this variable is used to track the
1319
        # exceptions to this rule).
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1320
        keep_this = False
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1321
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1322
        if hook_status == 'not_applicable':
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1323
            # No merge hook was able to resolve the situation. Two cases exist:
1324
            # a content conflict or a duplicate one.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1325
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1326
            name = self.tt.final_name(trans_id)
1327
            parent_id = self.tt.final_parent(trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1328
            duplicate = False
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1329
            inhibit_content_conflict = False
1330
            if params.this_kind is None: # file_id is not in THIS
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1331
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1332
                if self.this_tree.is_versioned(other_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1333
                    # Two entries for the same path
1334
                    keep_this = True
1335
                    # versioning the merged file will trigger a duplicate
1336
                    # conflict
1337
                    self.tt.version_file(file_id, trans_id)
1338
                    transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1339
                        self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1340
                        other_path, file_id=file_id,
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1341
                        filter_tree_path=self._get_filter_tree_path(file_id))
1342
                    inhibit_content_conflict = True
1343
            elif params.other_kind is None: # file_id is not in OTHER
1344
                # Is the name used for a different file_id ?
6883.10.1 by Jelmer Vernooij
Fix more tets.
1345
                if self.other_tree.is_versioned(this_path):
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1346
                    # Two entries for the same path again, but here, the other
1347
                    # entry will also be merged.  We simply inhibit the
1348
                    # 'content' conflict creation because we know OTHER will
1349
                    # create (or has already created depending on ordering) an
1350
                    # entry at the same path. This will trigger a 'duplicate'
1351
                    # conflict later.
1352
                    keep_this = True
1353
                    inhibit_content_conflict = True
1354
            if not inhibit_content_conflict:
1355
                if params.this_kind is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1356
                    self.tt.unversion_file(trans_id)
1357
                # This is a contents conflict, because none of the available
1358
                # functions could merge it.
6883.10.1 by Jelmer Vernooij
Fix more tets.
1359
                file_group = self._dump_conflicts(name, paths, parent_id, file_id,
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1360
                                                  set_version=True)
1361
                self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1362
        elif hook_status == 'success':
1363
            self.tt.create_file(lines, trans_id)
1364
        elif hook_status == 'conflicted':
1365
            # XXX: perhaps the hook should be able to provide
1366
            # the BASE/THIS/OTHER files?
1367
            self.tt.create_file(lines, trans_id)
1368
            self._raw_conflicts.append(('text conflict', trans_id))
1369
            name = self.tt.final_name(trans_id)
1370
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1371
            self._dump_conflicts(name, paths, parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1372
        elif hook_status == 'delete':
1373
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1374
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1375
        elif hook_status == 'done':
1376
            # The hook function did whatever it needs to do directly, no
1377
            # further action needed here.
1378
            pass
1379
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1380
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
6883.10.1 by Jelmer Vernooij
Fix more tets.
1381
        if not this_path and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1382
            self.tt.version_file(file_id, trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1383
        if not keep_this:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1384
            # The merge has been performed and produced a new content, so the
1385
            # old contents should not be retained.
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1386
            self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1387
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1388
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1389
    def _default_other_winner_merge(self, merge_hook_params):
1390
        """Replace this contents with other."""
1391
        file_id = merge_hook_params.file_id
1392
        trans_id = merge_hook_params.trans_id
6883.10.1 by Jelmer Vernooij
Fix more tets.
1393
        if merge_hook_params.other_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1394
            # OTHER changed the file
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1395
            transform.create_from_tree(
6809.4.7 by Jelmer Vernooij
Swap arguments for get_symlink_target and kind/stored_kind.
1396
                self.tt, trans_id, self.other_tree,
6883.10.1 by Jelmer Vernooij
Fix more tets.
1397
                merge_hook_params.other_path, file_id=file_id,
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1398
                filter_tree_path=self._get_filter_tree_path(file_id))
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1399
            return 'done', None
6883.10.1 by Jelmer Vernooij
Fix more tets.
1400
        elif merge_hook_params.this_path is not None:
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1401
            # OTHER deleted the file
1402
            return 'delete', None
1403
        else:
1404
            raise AssertionError(
1405
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1406
                % (file_id,))
1407
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1408
    def merge_contents(self, merge_hook_params):
1409
        """Fallback merge logic after user installed hooks."""
1410
        # This function is used in merge hooks as the fallback instance.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1411
        # Perhaps making this function and the functions it calls be a
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1412
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1413
        if merge_hook_params.winner == 'other':
1414
            # OTHER is a straight winner, so replace this contents with other
1415
            return self._default_other_winner_merge(merge_hook_params)
1416
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1417
            # THIS and OTHER are both files, so text merge.  Either
1418
            # BASE is a file, or both converted to files, so at least we
1419
            # have agreement that output should be a file.
1420
            try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1421
                self.text_merge(merge_hook_params.trans_id,
1422
                                merge_hook_params.paths, merge_hook_params.file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1423
            except errors.BinaryFile:
1424
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1425
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1426
        else:
1427
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1428
6883.10.1 by Jelmer Vernooij
Fix more tets.
1429
    def get_lines(self, tree, path, file_id=None):
1534.7.157 by Aaron Bentley
Added more docs
1430
        """Return the lines in a file, or an empty list."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1431
        if path is None:
1432
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1433
        try:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1434
            kind = tree.kind(path, file_id)
1435
        except errors.NoSuchFile:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1436
            return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1437
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1438
            if kind != 'file':
1439
                return []
6809.4.5 by Jelmer Vernooij
Swap arguments for get_file_*.
1440
            return tree.get_file_lines(path, file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1441
6883.10.1 by Jelmer Vernooij
Fix more tets.
1442
    def text_merge(self, trans_id, paths, file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1443
        """Perform a three-way text merge on a file_id"""
1444
        # it's possible that we got here with base as a different type.
1445
        # if so, we just want two-way text conflicts.
6883.10.1 by Jelmer Vernooij
Fix more tets.
1446
        base_path, other_path, this_path = paths
1447
        base_lines = self.get_lines(self.base_tree, base_path, file_id)
1448
        other_lines = self.get_lines(self.other_tree, other_path, file_id)
1449
        this_lines = self.get_lines(self.this_tree, this_path, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1450
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1451
                           is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1452
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1453
        if self.show_base is True:
1454
            base_marker = '|' * 7
1455
        else:
1456
            base_marker = None
1457
1458
        def iter_merge3(retval):
1459
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1460
            for line in m3.merge_lines(name_a = "TREE",
1461
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1462
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1463
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1464
                                       base_marker=base_marker,
1465
                                       reprocess=self.reprocess):
1466
                if line.startswith(start_marker):
1467
                    retval["text_conflicts"] = True
1468
                    yield line.replace(start_marker, '<' * 7)
1469
                else:
1470
                    yield line
1471
        retval = {}
1472
        merge3_iterator = iter_merge3(retval)
1473
        self.tt.create_file(merge3_iterator, trans_id)
1474
        if retval["text_conflicts"] is True:
1475
            self._raw_conflicts.append(('text conflict', trans_id))
1476
            name = self.tt.final_name(trans_id)
1477
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1478
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1479
                                              this_lines, base_lines,
1480
                                              other_lines)
1481
            file_group.append(trans_id)
1482
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1483
    def _get_filter_tree_path(self, file_id):
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1484
        if self.this_tree.supports_content_filtering():
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1485
            # We get the path from the working tree if it exists.
1486
            # That fails though when OTHER is adding a file, so
1487
            # we fall back to the other tree to find the path if
1488
            # it doesn't exist locally.
1489
            try:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1490
                return self.this_tree.id2path(file_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1491
            except errors.NoSuchId:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1492
                return self.other_tree.id2path(file_id)
1493
        # Skip the id2path lookup for older formats
1494
        return None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1495
6883.10.1 by Jelmer Vernooij
Fix more tets.
1496
    def _dump_conflicts(self, name, paths, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1497
                        base_lines=None, other_lines=None, set_version=False,
1498
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1499
        """Emit conflict files.
1500
        If this_lines, base_lines, or other_lines are omitted, they will be
1501
        determined automatically.  If set_version is true, the .OTHER, .THIS
1502
        or .BASE (in that order) will be created as versioned files.
1503
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1504
        base_path, other_path, this_path = paths
1505
        data = [('OTHER', self.other_tree, other_path, other_lines),
1506
                ('THIS', self.this_tree, this_path, this_lines)]
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1507
        if not no_base:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1508
            data.append(('BASE', self.base_tree, base_path, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1509
1510
        # We need to use the actual path in the working tree of the file here,
1511
        # ignoring the conflict suffixes
1512
        wt = self.this_tree
1513
        if wt.supports_content_filtering():
1514
            try:
1515
                filter_tree_path = wt.id2path(file_id)
1516
            except errors.NoSuchId:
1517
                # file has been deleted
1518
                filter_tree_path = None
1519
        else:
1520
            # Skip the id2path lookup for older formats
1521
            filter_tree_path = None
1522
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1523
        versioned = False
1524
        file_group = []
6883.10.1 by Jelmer Vernooij
Fix more tets.
1525
        for suffix, tree, path, lines in data:
1526
            if path is not None:
6809.4.21 by Jelmer Vernooij
Fix long lines.
1527
                trans_id = self._conflict_file(
1528
                        name, parent_id, path, tree, file_id, suffix, lines,
1529
                        filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1530
                file_group.append(trans_id)
1531
                if set_version and not versioned:
1532
                    self.tt.version_file(file_id, trans_id)
1533
                    versioned = True
1534
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1535
6809.4.21 by Jelmer Vernooij
Fix long lines.
1536
    def _conflict_file(self, name, parent_id, path, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1537
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1538
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1539
        name = name + '.' + suffix
1540
        trans_id = self.tt.create_path(name, parent_id)
6809.4.21 by Jelmer Vernooij
Fix long lines.
1541
        transform.create_from_tree(
1542
                self.tt, trans_id, tree, path,
1543
                file_id=file_id, bytes=lines,
1544
                filter_tree_path=filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1545
        return trans_id
1546
6883.10.1 by Jelmer Vernooij
Fix more tets.
1547
    def merge_executable(self, paths, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1548
        """Perform a merge on the execute bit."""
6883.10.1 by Jelmer Vernooij
Fix more tets.
1549
        executable = [self.executable(t, p, file_id) for t, p in zip([self.base_tree,
1550
                      self.other_tree, self.this_tree], paths)]
1551
        self._merge_executable(paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1552
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1553
6883.10.1 by Jelmer Vernooij
Fix more tets.
1554
    def _merge_executable(self, paths, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1555
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1556
        """Perform a merge on the execute bit."""
1557
        base_executable, other_executable, this_executable = executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1558
        base_path, other_path, this_path = paths
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1559
        if file_status == "deleted":
1560
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1561
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1562
        if winner == "conflict":
1563
        # There must be a None in here, if we have a conflict, but we
1564
        # need executability since file status was not deleted.
6883.10.1 by Jelmer Vernooij
Fix more tets.
1565
            if self.executable(self.other_tree, other_path, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1566
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1567
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1568
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1569
        if winner == 'this' and file_status != "modified":
1570
            return
1571
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1572
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1573
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1574
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1575
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1576
        else:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1577
            if other_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1578
                executability = other_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1579
            elif this_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1580
                executability = this_executable
6883.10.1 by Jelmer Vernooij
Fix more tets.
1581
            elif base_path is not None:
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1582
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1583
        if executability is not None:
1584
            trans_id = self.tt.trans_id_file_id(file_id)
1585
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1586
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1587
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1588
        """Convert all conflicts into a form that doesn't depend on trans_id"""
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1589
        content_conflict_file_ids = set()
1590
        cooked_conflicts = transform.cook_conflicts(fs_conflicts, self.tt)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1591
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1592
        for conflict in self._raw_conflicts:
1593
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1594
            if conflict_type == 'path conflict':
1595
                (trans_id, file_id,
1596
                this_parent, this_name,
1597
                other_parent, other_name) = conflict[1:]
1598
                if this_parent is None or this_name is None:
1599
                    this_path = '<deleted>'
1600
                else:
1601
                    parent_path =  fp.get_path(
1602
                        self.tt.trans_id_file_id(this_parent))
1603
                    this_path = osutils.pathjoin(parent_path, this_name)
1604
                if other_parent is None or other_name is None:
1605
                    other_path = '<deleted>'
1606
                else:
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1607
                    if other_parent == self.other_tree.get_root_id():
5050.73.9 by Vincent Ladeuil
Fix typo.
1608
                        # The tree transform doesn't know about the other root,
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1609
                        # so we special case here to avoid a NoFinalPath
1610
                        # exception
1611
                        parent_path = ''
1612
                    else:
1613
                        parent_path =  fp.get_path(
1614
                            self.tt.trans_id_file_id(other_parent))
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1615
                    other_path = osutils.pathjoin(parent_path, other_name)
1616
                c = _mod_conflicts.Conflict.factory(
1617
                    'path conflict', path=this_path,
1618
                    conflict_path=other_path,
1619
                    file_id=file_id)
1620
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1621
                for trans_id in conflict[1]:
1622
                    file_id = self.tt.final_file_id(trans_id)
1623
                    if file_id is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1624
                        # Ok we found the relevant file-id
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1625
                        break
1626
                path = fp.get_path(trans_id)
1627
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1628
                    if path.endswith(suffix):
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1629
                        # Here is the raw path
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1630
                        path = path[:-len(suffix)]
1631
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1632
                c = _mod_conflicts.Conflict.factory(conflict_type,
1633
                                                    path=path, file_id=file_id)
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1634
                content_conflict_file_ids.add(file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1635
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1636
                trans_id = conflict[1]
1637
                path = fp.get_path(trans_id)
1638
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1639
                c = _mod_conflicts.Conflict.factory(conflict_type,
1640
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1641
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1642
                raise AssertionError('bad conflict type: %r' % (conflict,))
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1643
            cooked_conflicts.append(c)
5988.2.2 by Vincent Ladeuil
Make it clear that we start from an empty cooked_conflicts list.
1644
1645
        self.cooked_conflicts = []
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1646
        # We want to get rid of path conflicts when a corresponding contents
1647
        # conflict exists. This can occur when one branch deletes a file while
1648
        # the other renames *and* modifies it. In this case, the content
1649
        # conflict is enough.
1650
        for c in cooked_conflicts:
1651
            if (c.typestring == 'path conflict'
1652
                and c.file_id in content_conflict_file_ids):
1653
                continue
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1654
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1655
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1656
1657
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1658
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1659
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1660
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1661
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1662
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1663
    history_based = True
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1664
    requires_file_merge_plan = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1665
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1666
    def _generate_merge_plan(self, file_id, base):
1667
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1668
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1669
1670
    def _merged_lines(self, file_id):
1671
        """Generate the merged lines.
1672
        There is no distinction between lines that are meant to contain <<<<<<<
1673
        and conflicts.
1674
        """
1675
        if self.cherrypick:
1676
            base = self.base_tree
1677
        else:
1678
            base = None
1679
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1680
        if 'merge' in debug.debug_flags:
1681
            plan = list(plan)
1682
            trans_id = self.tt.trans_id_file_id(file_id)
1683
            name = self.tt.final_name(trans_id) + '.plan'
4634.101.6 by John Arbash Meinel
killed-both and killed-base is 11 chars long.
1684
            contents = ('%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1685
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1686
        textmerge = versionedfile.PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1687
                                                 '>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1688
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1689
        if conflicts:
1690
            base_lines = textmerge.base_from_plan()
1691
        else:
1692
            base_lines = None
1693
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1694
6883.10.1 by Jelmer Vernooij
Fix more tets.
1695
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1696
        """Perform a (weave) text merge for a given file and file-id.
1697
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1698
        and a conflict will be noted.
1699
        """
6883.10.1 by Jelmer Vernooij
Fix more tets.
1700
        base_path, other_path, this_path = paths
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1701
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1702
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1703
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1704
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1705
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1706
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1707
        if base_lines is not None:
1708
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1709
            self._raw_conflicts.append(('text conflict', trans_id))
1710
            name = self.tt.final_name(trans_id)
1711
            parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1712
            file_group = self._dump_conflicts(name, paths, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1713
                                              no_base=False,
1714
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1715
            file_group.append(trans_id)
1716
1717
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1718
class LCAMerger(WeaveMerger):
1719
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1720
    requires_file_merge_plan = True
1721
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1722
    def _generate_merge_plan(self, file_id, base):
1723
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1724
                                                  base=base)
1725
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1726
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1727
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1728
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1729
    requires_file_merge_plan = False
1730
6883.10.1 by Jelmer Vernooij
Fix more tets.
1731
    def dump_file(self, temp_dir, name, tree, path, file_id=None):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1732
        out_path = osutils.pathjoin(temp_dir, name)
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1733
        with open(out_path, "wb") as out_file:
6883.10.1 by Jelmer Vernooij
Fix more tets.
1734
            in_file = tree.get_file(path, file_id=None)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1735
            for line in in_file:
1736
                out_file.write(line)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1737
        return out_path
1738
6883.10.1 by Jelmer Vernooij
Fix more tets.
1739
    def text_merge(self, trans_id, paths, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1740
        """Perform a diff3 merge using a specified file-id and trans-id.
1741
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1742
        will be dumped, and a will be conflict noted.
1743
        """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1744
        import breezy.patch
6883.10.1 by Jelmer Vernooij
Fix more tets.
1745
        base_path, other_path, this_path = paths
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1746
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1747
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1748
            new_file = osutils.pathjoin(temp_dir, "new")
6883.10.1 by Jelmer Vernooij
Fix more tets.
1749
            this = self.dump_file(temp_dir, "this", self.this_tree, this_path, file_id)
1750
            base = self.dump_file(temp_dir, "base", self.base_tree, base_path, file_id)
1751
            other = self.dump_file(temp_dir, "other", self.other_tree, other_path, file_id)
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1752
            status = breezy.patch.diff3(new_file, this, base, other)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1753
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1754
                raise errors.BzrError("Unhandled diff3 exit code")
6861.2.1 by Jelmer Vernooij
vf Move file planning to breezy.bzr.inventorytree.
1755
            with open(new_file, 'rb') as f:
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1756
                self.tt.create_file(f, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1757
            if status == 1:
1758
                name = self.tt.final_name(trans_id)
1759
                parent_id = self.tt.final_parent(trans_id)
6883.10.1 by Jelmer Vernooij
Fix more tets.
1760
                self._dump_conflicts(name, paths, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1761
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1762
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1763
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1764
1765
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1766
class PathNotInTree(errors.BzrError):
1767
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1768
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1769
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1770
    def __init__(self, path, tree):
1771
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1772
1773
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1774
class MergeIntoMerger(Merger):
1775
    """Merger that understands other_tree will be merged into a subdir.
1776
1777
    This also changes the Merger api so that it uses real Branch, revision_id,
1778
    and RevisonTree objects, rather than using revision specs.
1779
    """
1780
1781
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
5246.2.22 by Andrew Bennetts
Minor tweaks.
1782
            source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1783
        """Create a new MergeIntoMerger object.
1784
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1785
        source_subpath in other_tree will be effectively copied to
1786
        target_subdir in this_tree.
1787
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1788
        :param this_tree: The tree that we will be merging into.
1789
        :param other_branch: The Branch we will be merging from.
1790
        :param other_tree: The RevisionTree object we want to merge.
1791
        :param target_subdir: The relative path where we want to merge
1792
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1793
        :param source_subpath: The relative path specifying the subtree of
1794
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1795
        """
1796
        # It is assumed that we are merging a tree that is not in our current
1797
        # ancestry, which means we are using the "EmptyTree" as our basis.
1798
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
1799
                                _mod_revision.NULL_REVISION)
1800
        super(MergeIntoMerger, self).__init__(
1801
            this_branch=this_tree.branch,
1802
            this_tree=this_tree,
1803
            other_tree=other_tree,
1804
            base_tree=null_ancestor_tree,
1805
            )
1806
        self._target_subdir = target_subdir
1807
        self._source_subpath = source_subpath
1808
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1809
        if other_rev_id is None:
1810
            other_rev_id = other_tree.get_revision_id()
1811
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1812
        self.base_is_ancestor = True
1813
        self.backup_files = True
1814
        self.merge_type = Merge3Merger
1815
        self.show_base = False
1816
        self.reprocess = False
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1817
        self.interesting_files = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1818
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
1819
              target_subdir=self._target_subdir,
1820
              source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1821
        if self._source_subpath != '':
1822
            # If this isn't a partial merge make sure the revisions will be
1823
            # present.
1824
            self._maybe_fetch(self.other_branch, self.this_branch,
1825
                self.other_basis)
1826
1827
    def set_pending(self):
1828
        if self._source_subpath != '':
1829
            return
1830
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1831
1832
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1833
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1834
    """Wrap a merge-type class to provide extra parameters.
6861.2.3 by Jelmer Vernooij
Mark which merge types require plan_file_merge.
1835
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1836
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1837
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1838
    the 'merge_type' member.  It is difficult override do_merge without
1839
    re-writing the whole thing, so instead we create a wrapper which will pass
1840
    the extra parameters.
1841
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1842
1843
    def __init__(self, merge_type, **kwargs):
1844
        self._extra_kwargs = kwargs
1845
        self._merge_type = merge_type
1846
1847
    def __call__(self, *args, **kwargs):
1848
        kwargs.update(self._extra_kwargs)
1849
        return self._merge_type(*args, **kwargs)
1850
1851
    def __getattr__(self, name):
1852
        return getattr(self._merge_type, name)
1853
1854
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1855
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1856
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1857
1858
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1859
        """Initialize the merger object.
1860
1861
        :param args: See Merge3Merger.__init__'s args.
1862
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1863
            source_subpath and target_subdir.
1864
        :keyword source_subpath: The relative path specifying the subtree of
1865
            other_tree to merge into this_tree.
1866
        :keyword target_subdir: The relative path where we want to merge
1867
            other_tree into this_tree
1868
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1869
        # All of the interesting work happens during Merge3Merger.__init__(),
1870
        # so we have have to hack in to get our extra parameters set.
1871
        self._source_subpath = kwargs.pop('source_subpath')
1872
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1873
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1874
1875
    def _compute_transform(self):
6861.4.1 by Jelmer Vernooij
Make progress bars context managers.
1876
        with ui.ui_factory.nested_progress_bar() as child_pb:
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1877
            entries = self._entries_to_incorporate()
1878
            entries = list(entries)
6874.2.9 by Jelmer Vernooij
Fix test.
1879
            for num, (entry, parent_id, relpath) in enumerate(entries):
6138.4.1 by Jonathan Riddell
add gettext to progress bar strings
1880
                child_pb.update(gettext('Preparing file merge'), num, len(entries))
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1881
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
6874.2.9 by Jelmer Vernooij
Fix test.
1882
                path = osutils.pathjoin(self._source_subpath, relpath)
6874.2.8 by Jelmer Vernooij
Fix test.
1883
                trans_id = transform.new_by_entry(path, self.tt, entry,
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1884
                    parent_trans_id, self.other_tree)
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1885
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1886
1887
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1888
        """Yields pairs of (inventory_entry, new_parent)."""
6405.2.10 by Jelmer Vernooij
Fix more tests.
1889
        other_inv = self.other_tree.root_inventory
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1890
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1891
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1892
            # XXX: The error would be clearer if it gave the URL of the source
1893
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1894
            raise PathNotInTree(self._source_subpath, "Source tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1895
        subdir = other_inv[subdir_id]
1896
        parent_in_target = osutils.dirname(self._target_subdir)
6405.2.10 by Jelmer Vernooij
Fix more tests.
1897
        target_id = self.this_tree.path2id(parent_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1898
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1899
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1900
        name_in_target = osutils.basename(self._target_subdir)
1901
        merge_into_root = subdir.copy()
1902
        merge_into_root.name = name_in_target
6405.2.10 by Jelmer Vernooij
Fix more tests.
1903
        if self.this_tree.has_id(merge_into_root.file_id):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1904
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1905
            # This can happen fairly easily if the directory we are
1906
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1907
            # their root_id.  Users will expect this to Just Work, so we
1908
            # change the file-id here.
1909
            # Non-root file-ids could potentially conflict too.  That's really
1910
            # an edge case, so we don't do anything special for those.  We let
1911
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1912
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1913
        yield (merge_into_root, target_id, '')
5246.2.10 by Andrew Bennetts
Add more tests.
1914
        if subdir.kind != 'directory':
1915
            # No children, so we are done.
1916
            return
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1917
        for path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1918
            parent_id = entry.parent_id
1919
            if parent_id == subdir.file_id:
1920
                # The root's parent ID has changed, so make sure children of
1921
                # the root refer to the new ID.
1922
                parent_id = merge_into_root.file_id
6809.4.4 by Jelmer Vernooij
Swap arguments for Tree.is_executable.
1923
            yield (entry, parent_id, path)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1924
1925
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1926
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1927
                backup_files=False,
1928
                merge_type=Merge3Merger,
1929
                show_base=False,
1930
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1931
                other_rev_id=None,
1932
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1933
                this_tree=None,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
1934
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1935
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1936
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1937
    Typical use is probably::
1938
1939
        merge_inner(branch, branch.get_revision_tree(other_revision),
1940
                    branch.get_revision_tree(base_revision))
1941
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1942
    if this_tree is None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1943
        raise errors.BzrError("breezy.merge.merge_inner requires a this_tree "
5993.2.1 by Jelmer Vernooij
Add test for rootless tree merge.
1944
                              "parameter")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1945
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
6719.1.2 by Jelmer Vernooij
Fix some tests.
1946
                    change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1947
    merger.backup_files = backup_files
1948
    merger.merge_type = merge_type
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1949
    merger.ignore_zero = ignore_zero
6885.5.8 by Jelmer Vernooij
Remove interesting_ids support from merge.
1950
    merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1951
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1952
    merger.reprocess = reprocess
1953
    merger.other_rev_id = other_rev_id
1954
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1955
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1956
    if get_revision_id is None:
1957
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1958
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1959
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1960
    return merger.do_merge()
1961
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1962
1963
merge_type_registry = registry.Registry()
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1964
merge_type_registry.register('diff3', Diff3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1965
                             "Merge using external diff3.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1966
merge_type_registry.register('lca', LCAMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1967
                             "LCA-newness merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1968
merge_type_registry.register('merge3', Merge3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1969
                             "Native diff3-style merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1970
merge_type_registry.register('weave', WeaveMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1971
                             "Weave-based merge.")
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1972
1973
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1974
def get_merge_type_registry():
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1975
    """Merge type registry was previously in breezy.option
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1976
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1977
    This method provides a backwards compatible way to retrieve it.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1978
    """
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1979
    return merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1980
1981
1982
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1983
    def status_a(revision, text):
1984
        if revision in ancestors_b:
1985
            return 'killed-b', text
1986
        else:
1987
            return 'new-a', text
1988
1989
    def status_b(revision, text):
1990
        if revision in ancestors_a:
1991
            return 'killed-a', text
1992
        else:
1993
            return 'new-b', text
1994
1995
    plain_a = [t for (a, t) in annotated_a]
1996
    plain_b = [t for (a, t) in annotated_b]
1997
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1998
    blocks = matcher.get_matching_blocks()
1999
    a_cur = 0
2000
    b_cur = 0
2001
    for ai, bi, l in blocks:
2002
        # process all mismatched sections
2003
        # (last mismatched section is handled because blocks always
2004
        # includes a 0-length last block)
2005
        for revision, text in annotated_a[a_cur:ai]:
2006
            yield status_a(revision, text)
2007
        for revision, text in annotated_b[b_cur:bi]:
2008
            yield status_b(revision, text)
2009
        # and now the matched section
2010
        a_cur = ai + l
2011
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
2012
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
2013
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2014
2015
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2016
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2017
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2018
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2019
        """Contructor.
2020
2021
        :param a_rev: Revision-id of one revision to merge
2022
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2023
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2024
        :param key_prefix: A prefix for accessing keys in vf, typically
2025
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2026
        """
2027
        self.a_rev = a_rev
2028
        self.b_rev = b_rev
2029
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2030
        self._last_lines = None
2031
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2032
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2033
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2034
        self._precache_tip_lines()
2035
2036
    def _precache_tip_lines(self):
2037
        lines = self.get_lines([self.a_rev, self.b_rev])
2038
        self.lines_a = lines[self.a_rev]
2039
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2040
2041
    def get_lines(self, revisions):
2042
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2043
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2044
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2045
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2046
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2047
        result = {}
2048
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2049
            if record.storage_kind == 'absent':
2050
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2051
            result[record.key[-1]] = osutils.chunks_to_lines(
2052
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2053
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2054
2055
    def plan_merge(self):
2056
        """Generate a 'plan' for merging the two revisions.
2057
2058
        This involves comparing their texts and determining the cause of
2059
        differences.  If text A has a line and text B does not, then either the
2060
        line was added to text A, or it was deleted from B.  Once the causes
2061
        are combined, they are written out in the format described in
2062
        VersionedFile.plan_merge
2063
        """
2064
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2065
        unique_a, unique_b = self._unique_lines(blocks)
2066
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2067
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2068
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2069
2070
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2071
        last_i = 0
2072
        last_j = 0
2073
        for i, j, n in blocks:
2074
            for a_index in range(last_i, i):
2075
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2076
                    if a_index in killed_b:
2077
                        yield 'conflicted-a', self.lines_a[a_index]
2078
                    else:
2079
                        yield 'new-a', self.lines_a[a_index]
2080
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2081
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2082
            for b_index in range(last_j, j):
2083
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2084
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2085
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2086
                    else:
2087
                        yield 'new-b', self.lines_b[b_index]
2088
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2089
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2090
            # handle common lines
2091
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2092
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2093
            last_i = i+n
2094
            last_j = j+n
2095
2096
    def _get_matching_blocks(self, left_revision, right_revision):
2097
        """Return a description of which sections of two revisions match.
2098
2099
        See SequenceMatcher.get_matching_blocks
2100
        """
3144.3.7 by Aaron Bentley
Update from review
2101
        cached = self._cached_matching_blocks.get((left_revision,
2102
                                                   right_revision))
2103
        if cached is not None:
2104
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2105
        if self._last_lines_revision_id == left_revision:
2106
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2107
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2108
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2109
            lines = self.get_lines([left_revision, right_revision])
2110
            left_lines = lines[left_revision]
2111
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2112
        self._last_lines = right_lines
2113
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2114
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2115
                                                       right_lines)
2116
        return matcher.get_matching_blocks()
2117
2118
    def _unique_lines(self, matching_blocks):
2119
        """Analyse matching_blocks to determine which lines are unique
2120
2121
        :return: a tuple of (unique_left, unique_right), where the values are
2122
            sets of line numbers of unique lines.
2123
        """
2124
        last_i = 0
2125
        last_j = 0
2126
        unique_left = []
2127
        unique_right = []
2128
        for i, j, n in matching_blocks:
2129
            unique_left.extend(range(last_i, i))
2130
            unique_right.extend(range(last_j, j))
2131
            last_i = i + n
2132
            last_j = j + n
2133
        return unique_left, unique_right
2134
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2135
    @staticmethod
2136
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2137
        """Remove changes from new_plan that came from old_plan.
2138
2139
        It is assumed that the difference between the old_plan and new_plan
2140
        is their choice of 'b' text.
2141
2142
        All lines from new_plan that differ from old_plan are emitted
2143
        verbatim.  All lines from new_plan that match old_plan but are
2144
        not about the 'b' revision are emitted verbatim.
2145
2146
        Lines that match and are about the 'b' revision are the lines we
2147
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2148
        is skipped entirely.
2149
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2150
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2151
                                                       new_plan)
2152
        last_j = 0
2153
        for i, j, n in matcher.get_matching_blocks():
2154
            for jj in range(last_j, j):
2155
                yield new_plan[jj]
2156
            for jj in range(j, j+n):
2157
                plan_line = new_plan[jj]
2158
                if plan_line[0] == 'new-b':
2159
                    pass
2160
                elif plan_line[0] == 'killed-b':
2161
                    yield 'unchanged', plan_line[1]
2162
                else:
2163
                    yield plan_line
2164
            last_j = j + n
2165
2166
2167
class _PlanMerge(_PlanMergeBase):
2168
    """Plan an annotate merge using on-the-fly annotation"""
2169
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2170
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2171
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2172
        self.a_key = self._key_prefix + (self.a_rev,)
2173
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2174
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2175
        heads = self.graph.heads((self.a_key, self.b_key))
2176
        if len(heads) == 1:
2177
            # one side dominates, so we can just return its values, yay for
2178
            # per-file graphs
2179
            # Ideally we would know that before we get this far
2180
            self._head_key = heads.pop()
2181
            if self._head_key == self.a_key:
2182
                other = b_rev
2183
            else:
2184
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2185
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2186
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2187
            self._weave = None
2188
        else:
2189
            self._head_key = None
2190
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2191
2192
    def _precache_tip_lines(self):
2193
        # Turn this into a no-op, because we will do this later
2194
        pass
2195
2196
    def _find_recursive_lcas(self):
2197
        """Find all the ancestors back to a unique lca"""
2198
        cur_ancestors = (self.a_key, self.b_key)
2199
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2200
        # rather than a key tuple. We will just map that directly to no common
2201
        # ancestors.
2202
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2203
        while True:
2204
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2205
            # Map a plain NULL_REVISION to a simple no-ancestors
6619.3.12 by Jelmer Vernooij
Use 2to3 set_literal fixer.
2206
            if next_lcas == {_mod_revision.NULL_REVISION}:
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2207
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2208
            # Order the lca's based on when they were merged into the tip
2209
            # While the actual merge portion of weave merge uses a set() of
2210
            # active revisions, the order of insertion *does* effect the
2211
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2212
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2213
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2214
                                                                    next_lcas))
2215
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2216
            if len(next_lcas) == 0:
2217
                break
2218
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2219
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2220
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2221
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2222
                # More than 2 lca's, fall back to grabbing all nodes between
2223
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2224
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2225
                             ' %s, %s\n=> %s',
2226
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2227
                cur_lcas = next_lcas
2228
                while len(cur_lcas) > 1:
2229
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2230
                if len(cur_lcas) == 0:
2231
                    # No common base to find, use the full ancestry
2232
                    unique_lca = None
2233
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2234
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2235
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2236
                        # find_lca will return a plain 'NULL_REVISION' rather
2237
                        # than a key tuple when there is no common ancestor, we
2238
                        # prefer to just use None, because it doesn't confuse
2239
                        # _get_interesting_texts()
2240
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2241
                parent_map.update(self._find_unique_parents(next_lcas,
2242
                                                            unique_lca))
2243
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2244
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2245
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2246
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2247
    def _find_unique_parents(self, tip_keys, base_key):
2248
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2249
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2250
        :param tip_keys: Nodes that are interesting
2251
        :param base_key: Cull all ancestors of this node
2252
        :return: The parent map for all revisions between tip_keys and
2253
            base_key. base_key will be included. References to nodes outside of
2254
            the ancestor set will also be removed.
2255
        """
2256
        # TODO: this would be simpler if find_unique_ancestors took a list
2257
        #       instead of a single tip, internally it supports it, but it
2258
        #       isn't a "backwards compatible" api change.
2259
        if base_key is None:
2260
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2261
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2262
            # thus confuses things like _get_interesting_texts, and our logic
2263
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2264
            if _mod_revision.NULL_REVISION in parent_map:
2265
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2266
        else:
2267
            interesting = set()
2268
            for tip in tip_keys:
2269
                interesting.update(
2270
                    self.graph.find_unique_ancestors(tip, [base_key]))
2271
            parent_map = self.graph.get_parent_map(interesting)
2272
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2273
        culled_parent_map, child_map, tails = self._remove_external_references(
2274
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2275
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2276
        if base_key is not None:
2277
            tails.remove(base_key)
2278
            self._prune_tails(culled_parent_map, child_map, tails)
2279
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2280
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2281
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2282
2283
    @staticmethod
2284
    def _remove_external_references(parent_map):
2285
        """Remove references that go outside of the parent map.
2286
2287
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2288
        :return: (filtered_parent_map, child_map, tails)
2289
            filtered_parent_map is parent_map without external references
2290
            child_map is the {parent_key: [child_keys]} mapping
2291
            tails is a list of nodes that do not have any parents in the map
2292
        """
2293
        # TODO: The basic effect of this function seems more generic than
2294
        #       _PlanMerge. But the specific details of building a child_map,
2295
        #       and computing tails seems very specific to _PlanMerge.
2296
        #       Still, should this be in Graph land?
2297
        filtered_parent_map = {}
2298
        child_map = {}
2299
        tails = []
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
2300
        for key, parent_keys in viewitems(parent_map):
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2301
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2302
            if not culled_parent_keys:
2303
                tails.append(key)
2304
            for parent_key in culled_parent_keys:
2305
                child_map.setdefault(parent_key, []).append(key)
2306
            # TODO: Do we want to do this, it adds overhead for every node,
2307
            #       just to say that the node has no children
2308
            child_map.setdefault(key, [])
2309
            filtered_parent_map[key] = culled_parent_keys
2310
        return filtered_parent_map, child_map, tails
2311
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2312
    @staticmethod
2313
    def _prune_tails(parent_map, child_map, tails_to_remove):
2314
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2315
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2316
        This will remove the supplied revisions until no more children have 0
2317
        parents.
2318
2319
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2320
            be modified in place.
2321
        :param tails_to_remove: A list of tips that should be removed,
2322
            this list will be consumed
2323
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2324
            this dict will be modified
2325
        :return: None, parent_map will be modified in place.
2326
        """
2327
        while tails_to_remove:
2328
            next = tails_to_remove.pop()
2329
            parent_map.pop(next)
2330
            children = child_map.pop(next)
2331
            for child in children:
2332
                child_parents = parent_map[child]
2333
                child_parents.remove(next)
2334
                if len(child_parents) == 0:
2335
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2336
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2337
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2338
        """Return a dict of texts we are interested in.
2339
2340
        Note that the input is in key tuples, but the output is in plain
2341
        revision ids.
2342
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2343
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2344
        :return: A dict of {'revision_id':lines} as returned by
2345
            _PlanMergeBase.get_lines()
2346
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2347
        all_revision_keys = set(parent_map)
2348
        all_revision_keys.add(self.a_key)
2349
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2350
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2351
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2352
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2353
        return all_texts
2354
2355
    def _build_weave(self):
6670.4.3 by Jelmer Vernooij
Fix more imports.
2356
        from .bzr import weave
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2357
        self._weave = weave.Weave(weave_name='in_memory_weave',
2358
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2359
        parent_map = self._find_recursive_lcas()
2360
2361
        all_texts = self._get_interesting_texts(parent_map)
2362
2363
        # Note: Unfortunately, the order given by topo_sort will effect the
2364
        # ordering resolution in the output. Specifically, if you add A then B,
2365
        # then in the output text A lines will show up before B lines. And, of
2366
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2367
        # So we use merge_sort, and add a fake node on the tip.
2368
        # This ensures that left-hand parents will always be inserted into the
2369
        # weave before right-hand parents.
2370
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2371
        parent_map[tip_key] = (self.a_key, self.b_key)
2372
2373
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2374
                                                                  tip_key)):
2375
            if key == tip_key:
2376
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2377
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2378
            parent_keys = parent_map[key]
2379
            revision_id = key[-1]
2380
            parent_ids = [k[-1] for k in parent_keys]
2381
            self._weave.add_lines(revision_id, parent_ids,
2382
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2383
2384
    def plan_merge(self):
2385
        """Generate a 'plan' for merging the two revisions.
2386
2387
        This involves comparing their texts and determining the cause of
2388
        differences.  If text A has a line and text B does not, then either the
2389
        line was added to text A, or it was deleted from B.  Once the causes
2390
        are combined, they are written out in the format described in
2391
        VersionedFile.plan_merge
2392
        """
2393
        if self._head_key is not None: # There was a single head
2394
            if self._head_key == self.a_key:
2395
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2396
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2397
                if self._head_key != self.b_key:
2398
                    raise AssertionError('There was an invalid head: %s != %s'
2399
                                         % (self.b_key, self._head_key))
2400
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2401
            head_rev = self._head_key[-1]
2402
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2403
            return ((plan, line) for line in lines)
2404
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2405
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2406
2407
class _PlanLCAMerge(_PlanMergeBase):
2408
    """
3144.3.7 by Aaron Bentley
Update from review
2409
    This merge algorithm differs from _PlanMerge in that:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2410
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2411
    1. comparisons are done against LCAs only
2412
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2413
       another are marked as conflicts, by emitting the line as conflicted-a
2414
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2415
2416
    This is faster, and hopefully produces more useful output.
2417
    """
2418
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2419
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2420
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2421
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2422
        self.lcas = set()
2423
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2424
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2425
                self.lcas.add(lca)
2426
            else:
2427
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2428
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2429
            if _mod_revision.is_null(lca):
2430
                lca_lines = []
2431
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2432
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2433
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2434
                                                           lca_lines)
2435
            blocks = list(matcher.get_matching_blocks())
2436
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2437
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2438
                                                           lca_lines)
2439
            blocks = list(matcher.get_matching_blocks())
2440
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2441
3144.3.7 by Aaron Bentley
Update from review
2442
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2443
        """Determines the status unique lines versus all lcas.
2444
2445
        Basically, determines why the line is unique to this revision.
2446
2447
        A line may be determined new, killed, or both.
2448
3144.3.7 by Aaron Bentley
Update from review
2449
        If a line is determined new, that means it was not present in at least
2450
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2451
2452
        If a line is determined killed, that means the line was present in
2453
        at least one LCA.
2454
2455
        If a line is killed and new, this indicates that the two merge
2456
        revisions contain differing conflict resolutions.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2457
3144.3.7 by Aaron Bentley
Update from review
2458
        :param revision_id: The id of the revision in which the lines are
2459
            unique
2460
        :param unique_line_numbers: The line numbers of unique lines.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2461
        :return: a tuple of (new_this, killed_other)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2462
        """
2463
        new = set()
2464
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2465
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2466
        for lca in self.lcas:
2467
            blocks = self._get_matching_blocks(revision_id, lca)
2468
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2469
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2470
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2471
        return new, killed