/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
6379.6.1 by Jelmer Vernooij
Import absolute_import in a few places.
17
from __future__ import absolute_import
18
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
19
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
20
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
21
from .lazy_import import lazy_import
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
22
lazy_import(globals(), """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
23
from breezy import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
25
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
26
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
27
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
28
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
29
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
30
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
31
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
32
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
33
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
34
    textfile,
35
    trace,
36
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
37
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
38
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
39
    ui,
6670.4.3 by Jelmer Vernooij
Fix more imports.
40
    workingtree,
41
    )
42
from breezy.bzr import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
43
    versionedfile,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
44
    )
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
45
from breezy.i18n import gettext
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
46
""")
6624 by Jelmer Vernooij
Merge Python3 porting work ('py3 pokes')
47
from . import (
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
48
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
49
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
50
    hooks,
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
51
    registry,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
52
    )
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
53
from .sixish import (
54
    viewitems,
55
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
56
# TODO: Report back as changes are merged in
57
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
58
1185.35.4 by Aaron Bentley
Implemented remerge
59
def transform_tree(from_tree, to_tree, interesting_ids=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
60
    from_tree.lock_tree_write()
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
61
    operation = cleanup.OperationWithCleanups(merge_inner)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
62
    operation.add_cleanup(from_tree.unlock)
63
    operation.run_simple(from_tree.branch, to_tree, from_tree,
64
        ignore_zero=True, interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
65
1457.1.12 by Robert Collins
Update comment to reflect author.
66
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
67
class MergeHooks(hooks.Hooks):
68
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
69
    def __init__(self):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
70
        hooks.Hooks.__init__(self, "breezy.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
71
        self.add_hook('merge_file_content',
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
72
            "Called with a breezy.merge.Merger object to create a per file "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
73
            "merge object when starting a merge. "
74
            "Should return either None or a subclass of "
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
75
            "``breezy.merge.AbstractPerFileMerger``. "
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
76
            "Such objects will then be called per file "
77
            "that needs to be merged (including when one "
78
            "side has deleted the file and the other has changed it). "
79
            "See the AbstractPerFileMerger API docs for details on how it is "
80
            "used by merge.",
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
81
            (2, 1))
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
82
        self.add_hook('pre_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
83
            'Called before a merge. '
84
            'Receives a Merger object as the single argument.',
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
85
            (2, 5))
86
        self.add_hook('post_merge',
6388.1.4 by Jelmer Vernooij
Fix tests.
87
            'Called after a merge. '
88
            'Receives a Merger object as the single argument. '
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
89
            'The return value is ignored.',
90
            (2, 5))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
91
92
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
93
class AbstractPerFileMerger(object):
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
94
    """PerFileMerger objects are used by plugins extending merge for breezy.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
95
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
96
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
97
    
98
    :ivar merger: The Merge3Merger performing the merge.
99
    """
100
101
    def __init__(self, merger):
102
        """Create a PerFileMerger for use with merger."""
103
        self.merger = merger
104
105
    def merge_contents(self, merge_params):
106
        """Attempt to merge the contents of a single file.
107
        
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
108
        :param merge_params: A breezy.merge.MergeFileHookParams
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
109
        :return: A tuple of (status, chunks), where status is one of
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
110
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
111
            is 'success' or 'conflicted', then chunks should be an iterable of
112
            strings for the new file contents.
113
        """
114
        return ('not applicable', None)
115
116
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
117
class PerFileMerger(AbstractPerFileMerger):
118
    """Merge individual files when self.file_matches returns True.
119
120
    This class is intended to be subclassed.  The file_matches and
121
    merge_matching methods should be overridden with concrete implementations.
122
    """
123
124
    def file_matches(self, params):
125
        """Return True if merge_matching should be called on this file.
126
127
        Only called with merges of plain files with no clear winner.
128
129
        Subclasses must override this.
130
        """
131
        raise NotImplementedError(self.file_matches)
132
133
    def get_filename(self, params, tree):
134
        """Lookup the filename (i.e. basename, not path), given a Tree (e.g.
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
135
        self.merger.this_tree) and a MergeFileHookParams.
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
136
        """
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
137
        return osutils.basename(tree.id2path(params.file_id))
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
138
139
    def get_filepath(self, params, tree):
140
        """Calculate the path to the file in a tree.
141
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
142
        :param params: A MergeFileHookParams describing the file to merge
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
143
        :param tree: a Tree, e.g. self.merger.this_tree.
144
        """
145
        return tree.id2path(params.file_id)
146
147
    def merge_contents(self, params):
148
        """Merge the contents of a single file."""
149
        # Check whether this custom merge logic should be used.
150
        if (
151
            # OTHER is a straight winner, rely on default merge.
152
            params.winner == 'other' or
153
            # THIS and OTHER aren't both files.
154
            not params.is_file_merge() or
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
155
            # The filename doesn't match
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
156
            not self.file_matches(params)):
157
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
158
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
159
160
    def merge_matching(self, params):
161
        """Merge the contents of a single file that has matched the criteria
162
        in PerFileMerger.merge_contents (is a conflict, is a file,
163
        self.file_matches is True).
164
165
        Subclasses must override this.
166
        """
167
        raise NotImplementedError(self.merge_matching)
168
169
170
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
171
    """Merge individual files when configured via a .conf file.
172
173
    This is a base class for concrete custom file merging logic. Concrete
174
    classes should implement ``merge_text``.
175
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
176
    See ``breezy.plugins.news_merge.news_merge`` for an example concrete class.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
177
    
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
178
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
179
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
180
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
181
        details. <name_prefix>_merge_files describes the files targeted by the
182
        hook for example.
183
        
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
184
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
185
        is present.
186
    """
187
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
188
    name_prefix = None
189
    default_files = None
190
191
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
192
        super(ConfigurableFileMerger, self).__init__(merger)
193
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
194
        self.default_files = self.__class__.default_files or []
195
        self.name_prefix = self.__class__.name_prefix
196
        if self.name_prefix is None:
197
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
198
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
199
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
200
        """Check whether the file should call the merge hook.
201
202
        <name_prefix>_merge_files configuration variable is a list of files
203
        that should use the hook.
204
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
205
        affected_files = self.affected_files
206
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
207
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
208
            # Until bzr provides a better policy for caching the config, we
209
            # just add the part we're interested in to the params to avoid
210
            # reading the config files repeatedly (bazaar.conf, location.conf,
211
            # branch.conf).
212
            config_key = self.name_prefix + '_merge_files'
213
            affected_files = config.get_user_option_as_list(config_key)
214
            if affected_files is None:
215
                # If nothing was specified in the config, use the default.
216
                affected_files = self.default_files
217
            self.affected_files = affected_files
218
        if affected_files:
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
219
            filepath = self.get_filepath(params, self.merger.this_tree)
220
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
221
                return True
222
        return False
223
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
224
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
225
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
226
227
    def merge_text(self, params):
228
        """Merge the byte contents of a single file.
229
230
        This is called after checking that the merge should be performed in
231
        merge_contents, and it should behave as per
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
232
        ``breezy.merge.AbstractPerFileMerger.merge_contents``.
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
233
        """
234
        raise NotImplementedError(self.merge_text)
235
236
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
237
class MergeFileHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
238
    """Object holding parameters passed to merge_file_content hooks.
239
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
240
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
241
242
    :ivar file_id: the file ID of the file being merged
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
243
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
244
    :ivar this_kind: kind of file_id in 'this' tree
245
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
246
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
247
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
248
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
249
    def __init__(self, merger, file_id, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
250
            winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
251
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
252
        self.file_id = file_id
253
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
254
        self.this_kind = this_kind
255
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
256
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
257
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
258
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
259
        """True if this_kind and other_kind are both 'file'."""
260
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
261
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
262
    @decorators.cachedproperty
263
    def base_lines(self):
264
        """The lines of the 'base' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
265
        return self._merger.get_lines(self._merger.base_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
266
267
    @decorators.cachedproperty
268
    def this_lines(self):
269
        """The lines of the 'this' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
270
        return self._merger.get_lines(self._merger.this_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
271
272
    @decorators.cachedproperty
273
    def other_lines(self):
274
        """The lines of the 'other' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
275
        return self._merger.get_lines(self._merger.other_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
276
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
277
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
278
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
279
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
280
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
281
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
282
    def __init__(self, this_branch, other_tree=None, base_tree=None,
1551.21.8 by Aaron Bentley
Remove now-redundant DummyProgress from Merger.__init__
283
                 this_tree=None, pb=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
284
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
285
        object.__init__(self)
286
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
287
        self.this_basis = _mod_revision.ensure_null(
288
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
289
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
290
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
291
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
292
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
293
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
294
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
295
        self.base_tree = base_tree
296
        self.ignore_zero = False
297
        self.backup_files = False
298
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
299
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
300
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
301
        self.reprocess = False
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
302
        if pb is not None:
303
            warnings.warn("pb parameter to Merger() is deprecated and ignored")
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
304
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
305
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
306
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
307
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
308
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
309
        self._base_is_ancestor = None
310
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
311
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
312
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
313
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
314
    def cache_trees_with_revision_ids(self, trees):
315
        """Cache any tree in trees if it has a revision_id."""
316
        for maybe_tree in trees:
317
            if maybe_tree is None:
318
                continue
319
            try:
320
                rev_id = maybe_tree.get_revision_id()
321
            except AttributeError:
322
                continue
323
            self._cached_trees[rev_id] = maybe_tree
324
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
325
    @property
326
    def revision_graph(self):
327
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
328
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
329
        return self._revision_graph
330
331
    def _set_base_is_ancestor(self, value):
332
        self._base_is_ancestor = value
333
334
    def _get_base_is_ancestor(self):
335
        if self._base_is_ancestor is None:
336
            self._base_is_ancestor = self.revision_graph.is_ancestor(
337
                self.base_rev_id, self.this_basis)
338
        return self._base_is_ancestor
339
340
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
341
342
    def _set_base_is_other_ancestor(self, value):
343
        self._base_is_other_ancestor = value
344
345
    def _get_base_is_other_ancestor(self):
346
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
347
            if self.other_basis is None:
348
                return True
349
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
350
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
351
        return self._base_is_other_ancestor
352
353
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
354
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
355
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
356
    @staticmethod
1551.21.7 by Aaron Bentley
Fix progress warning
357
    def from_uncommitted(tree, other_tree, pb=None, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
358
        """Return a Merger for uncommitted changes in other_tree.
359
360
        :param tree: The tree to merge into
361
        :param other_tree: The tree to get uncommitted changes from
362
        :param pb: A progress indicator
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
363
        :param base_tree: The basis to use for the merge.  If unspecified,
364
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
365
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
366
        if base_tree is None:
367
            base_tree = other_tree.basis_tree()
368
        merger = Merger(tree.branch, other_tree, base_tree, tree, pb)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
369
        merger.base_rev_id = merger.base_tree.get_revision_id()
370
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
371
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
372
        return merger
373
374
    @classmethod
375
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
376
        """Return a Merger for a bundle or merge directive.
377
378
        :param tree: The tree to merge changes into
379
        :param mergeable: A merge directive or bundle
380
        :param pb: A progress indicator
381
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
382
        mergeable.install_revisions(tree.branch.repository)
383
        base_revision_id, other_revision_id, verified =\
384
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
385
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
386
        if base_revision_id is not None:
387
            if (base_revision_id != _mod_revision.NULL_REVISION and
388
                revision_graph.is_ancestor(
389
                base_revision_id, tree.branch.last_revision())):
390
                base_revision_id = None
391
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
392
                trace.warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
393
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
394
                                         base_revision_id, revision_graph=
395
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
396
        return merger, verified
397
398
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
399
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
400
                          base_branch=None, revision_graph=None,
401
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
402
        """Return a Merger for revision-ids.
403
3363.17.15 by Aaron Bentley
Update docs
404
        :param pb: A progress indicator
1551.15.74 by Aaron Bentley
Textual updates from review
405
        :param tree: The tree to merge changes into
406
        :param other: The revision-id to use as OTHER
407
        :param base: The revision-id to use as BASE.  If not specified, will
408
            be auto-selected.
409
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
410
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
411
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
412
            not supplied, other_branch or tree.branch will be used.
413
        :param revision_graph: If you have a revision_graph precomputed, pass
414
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
415
        :param tree_branch: The branch associated with tree.  If not supplied,
416
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
417
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
418
        if tree_branch is None:
419
            tree_branch = tree.branch
420
        merger = Merger(tree_branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
421
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
422
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
423
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
424
        merger.set_other_revision(other, other_branch)
425
        if base is None:
426
            merger.find_base()
427
        else:
428
            if base_branch is None:
429
                base_branch = other_branch
430
            merger.set_base_revision(base, base_branch)
431
        return merger
432
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
433
    def revision_tree(self, revision_id, branch=None):
434
        if revision_id not in self._cached_trees:
435
            if branch is None:
436
                branch = self.this_branch
437
            try:
438
                tree = self.this_tree.revision_tree(revision_id)
439
            except errors.NoSuchRevisionInTree:
440
                tree = branch.repository.revision_tree(revision_id)
441
            self._cached_trees[revision_id] = tree
442
        return self._cached_trees[revision_id]
443
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
444
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
445
        location, revno = treespec
446
        if revno is None:
447
            tree = workingtree.WorkingTree.open_containing(location)[0]
448
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
449
        branch = _mod_branch.Branch.open_containing(
450
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
451
        if revno == -1:
452
            revision_id = branch.last_revision()
453
        else:
454
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
455
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
456
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
457
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
458
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
459
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
460
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
461
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
462
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
463
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
464
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
465
        self._add_parent()
466
467
    def _add_parent(self):
468
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
469
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
470
        operation = cleanup.OperationWithCleanups(
471
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
472
        for revision_id in new_parents:
473
            try:
474
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
475
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
476
                tree = None
477
            else:
478
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
479
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
480
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
481
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
482
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
483
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
484
        """Set the revision and tree to merge from.
485
486
        This sets the other_tree, other_rev_id, other_basis attributes.
487
488
        :param other_revision: The [path, revision] list to merge from.
489
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
490
        self.other_branch, self.other_tree = self._get_tree(other_revision,
491
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
492
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
493
            self.other_rev_id = _mod_revision.ensure_null(
494
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
495
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
496
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
497
            self.other_basis = self.other_rev_id
498
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
499
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
500
            self.other_basis = self.other_rev_id
501
        else:
502
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
503
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
504
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
505
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
506
        if self.other_rev_id is not None:
507
            self._cached_trees[self.other_rev_id] = self.other_tree
6388.1.2 by Jelmer Vernooij
Fix formatting.
508
        self._maybe_fetch(self.other_branch, self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
509
2100.3.29 by Aaron Bentley
Get merge working initially
510
    def set_other_revision(self, revision_id, other_branch):
511
        """Set 'other' based on a branch and revision id
512
513
        :param revision_id: The revision to use for a tree
514
        :param other_branch: The branch containing this tree
515
        """
516
        self.other_rev_id = revision_id
517
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
518
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
519
        self.other_tree = self.revision_tree(revision_id)
520
        self.other_basis = revision_id
521
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
522
    def set_base_revision(self, revision_id, branch):
523
        """Set 'base' based on a branch and revision id
524
525
        :param revision_id: The revision to use for a tree
526
        :param branch: The branch containing this tree
527
        """
528
        self.base_rev_id = revision_id
529
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
530
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
531
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
532
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
533
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
534
        if not source.repository.has_same_location(target.repository):
5741.1.9 by Jelmer Vernooij
Remove fetch_tags argument.
535
            target.fetch(source, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
536
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
537
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
538
        revisions = [_mod_revision.ensure_null(self.this_basis),
539
                     _mod_revision.ensure_null(self.other_basis)]
540
        if _mod_revision.NULL_REVISION in revisions:
541
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
542
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
543
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
544
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
545
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
546
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
547
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
548
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
549
            elif len(lcas) == 1:
550
                self.base_rev_id = list(lcas)[0]
551
            else: # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
552
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
553
                if len(lcas) > 2:
554
                    # find_unique_lca can only handle 2 nodes, so we have to
555
                    # start back at the beginning. It is a shame to traverse
556
                    # the graph again, but better than re-implementing
557
                    # find_unique_lca.
558
                    self.base_rev_id = self.revision_graph.find_unique_lca(
559
                                            revisions[0], revisions[1])
560
                else:
561
                    self.base_rev_id = self.revision_graph.find_unique_lca(
562
                                            *lcas)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
563
                sorted_lca_keys = self.revision_graph.find_merge_order(
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
564
                    revisions[0], lcas)
565
                if self.base_rev_id == _mod_revision.NULL_REVISION:
566
                    self.base_rev_id = sorted_lca_keys[0]
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
567
4721.3.1 by Vincent Ladeuil
Cleanup imports.
568
            if self.base_rev_id == _mod_revision.NULL_REVISION:
569
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
570
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
571
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
572
                              ' help criss-cross.')
573
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
574
                if self.base_rev_id in lcas:
575
                    trace.mutter('Unable to find unique lca. '
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
576
                                 'Fallback %r as best option.'
577
                                 % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
578
                interesting_revision_ids = set(lcas)
579
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
580
                interesting_trees = dict((t.get_revision_id(), t)
581
                    for t in self.this_branch.repository.revision_trees(
582
                        interesting_revision_ids))
583
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
584
                if self.base_rev_id in lcas:
585
                    self.base_tree = interesting_trees[self.base_rev_id]
586
                else:
587
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
588
                self._lca_trees = [interesting_trees[key]
589
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
590
            else:
591
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
592
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
593
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
594
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
595
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
596
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
597
        """Set the base revision to use for the merge.
598
599
        :param base_revision: A 2-list containing a path and revision number.
600
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
601
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
602
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
603
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
604
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
605
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
606
            if base_revision[1] == -1:
607
                self.base_rev_id = base_branch.last_revision()
608
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
609
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
610
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
611
                self.base_rev_id = _mod_revision.ensure_null(
612
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
613
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
614
3008.1.8 by Michael Hudson
extract merger creation into a method
615
    def make_merger(self):
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
616
        kwargs = {'working_tree': self.this_tree, 'this_tree': self.this_tree,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
617
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
618
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
619
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
620
                  'this_branch': self.this_branch,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
621
                  'other_branch': self.other_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
622
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
623
        if self.merge_type.requires_base:
624
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
625
        if self.merge_type.supports_reprocess:
626
            kwargs['reprocess'] = self.reprocess
627
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
628
            raise errors.BzrError(
629
                "Conflict reduction is not supported for merge"
630
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
631
        if self.merge_type.supports_show_base:
632
            kwargs['show_base'] = self.show_base
633
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
634
            raise errors.BzrError("Showing base is not supported for this"
635
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
636
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
637
            and not self.base_is_other_ancestor):
638
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
639
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
640
            kwargs['cherrypick'] = (not self.base_is_ancestor or
641
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
642
        if self._is_criss_cross and getattr(self.merge_type,
643
                                            'supports_lca_trees', False):
644
            kwargs['lca_trees'] = self._lca_trees
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
645
        return self.merge_type(pb=None,
3008.1.8 by Michael Hudson
extract merger creation into a method
646
                               change_reporter=self.change_reporter,
647
                               **kwargs)
648
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
649
    def _do_merge_to(self):
650
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
651
        if self.other_branch is not None:
652
            self.other_branch.update_references(self.this_branch)
6388.1.4 by Jelmer Vernooij
Fix tests.
653
        for hook in Merger.hooks['pre_merge']:
654
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
655
        merge.do_merge()
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
656
        for hook in Merger.hooks['post_merge']:
657
            hook(merge)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
658
        if self.recurse == 'down':
659
            for relpath, file_id in self.this_tree.iter_references():
660
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
661
                other_revision = self.other_tree.get_reference_revision(
662
                    file_id, relpath)
663
                if  other_revision == sub_tree.last_revision():
664
                    continue
665
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
666
                sub_merge.merge_type = self.merge_type
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
667
                other_branch = self.other_branch.reference_parent(file_id,
668
                                                                  relpath)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
669
                sub_merge.set_other_revision(other_revision, other_branch)
670
                base_revision = self.base_tree.get_reference_revision(file_id)
671
                sub_merge.base_tree = \
672
                    sub_tree.branch.repository.revision_tree(base_revision)
673
                sub_merge.base_rev_id = base_revision
674
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
675
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
676
3008.1.8 by Michael Hudson
extract merger creation into a method
677
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
678
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
679
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
680
        operation.add_cleanup(self.this_tree.unlock)
681
        if self.base_tree is not None:
682
            self.base_tree.lock_read()
683
            operation.add_cleanup(self.base_tree.unlock)
684
        if self.other_tree is not None:
685
            self.other_tree.lock_read()
686
            operation.add_cleanup(self.other_tree.unlock)
687
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
688
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
689
            if not self.ignore_zero and not trace.is_quiet():
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
690
                trace.note(gettext("All changes applied successfully."))
1534.7.141 by Aaron Bentley
Added conflict reporting
691
        else:
6138.3.4 by Jonathan Riddell
add gettext() to uses of trace.note()
692
            trace.note(gettext("%d conflicts encountered.")
4721.3.1 by Vincent Ladeuil
Cleanup imports.
693
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
694
1534.7.134 by Aaron Bentley
Hid raw conflicts
695
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
696
1545.2.4 by Aaron Bentley
PEP8 fixes
697
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
698
class _InventoryNoneEntry(object):
699
    """This represents an inventory entry which *isn't there*.
700
701
    It simplifies the merging logic if we always have an InventoryEntry, even
702
    if it isn't actually present
703
    """
704
    executable = None
705
    kind = None
706
    name = None
707
    parent_id = None
708
    revision = None
709
    symlink_target = None
710
    text_sha1 = None
711
712
_none_entry = _InventoryNoneEntry()
713
714
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
715
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
716
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
717
    requires_base = True
718
    supports_reprocess = True
719
    supports_show_base = True
720
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
721
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
722
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
723
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
724
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
725
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
726
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
727
                 interesting_ids=None, reprocess=False, show_base=False,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
728
                 pb=None, pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
729
                 interesting_files=None, do_merge=True,
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
730
                 cherrypick=False, lca_trees=None, this_branch=None,
731
                 other_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
732
        """Initialize the merger object and perform the merge.
733
734
        :param working_tree: The working tree to apply the merge to
735
        :param this_tree: The local tree in the merge operation
736
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
737
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
738
        :param this_branch: The branch associated with this_tree.  Defaults to
739
            this_tree.branch if not supplied.
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
740
        :param other_branch: The branch associated with other_tree, if any.
2590.2.10 by Aaron Bentley
Updates from review
741
        :param interesting_ids: The file_ids of files that should be
742
            participate in the merge.  May not be combined with
743
            interesting_files.
744
        :param: reprocess If True, perform conflict-reduction processing.
745
        :param show_base: If True, show the base revision in text conflicts.
746
            (incompatible with reprocess)
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
747
        :param pb: ignored
2590.2.10 by Aaron Bentley
Updates from review
748
        :param pp: A ProgressPhase object
749
        :param change_reporter: An object that should report changes made
750
        :param interesting_files: The tree-relative paths of files that should
751
            participate in the merge.  If these paths refer to directories,
752
            the contents of those directories will also be included.  May not
753
            be combined with interesting_ids.  If neither interesting_files nor
754
            interesting_ids is specified, all files may participate in the
755
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
756
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
757
            if the ancestry was found to include a criss-cross merge.
758
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
759
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
760
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
761
        if interesting_files is not None and interesting_ids is not None:
762
            raise ValueError(
763
                'specify either interesting_ids or interesting_files')
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
764
        if this_branch is None:
765
            this_branch = this_tree.branch
2590.2.4 by Aaron Bentley
Move entry generation to a helper
766
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
767
        self.interesting_files = interesting_files
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
768
        self.working_tree = working_tree
769
        self.this_tree = this_tree
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
770
        self.base_tree = base_tree
771
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
772
        self.this_branch = this_branch
6410.1.1 by Jelmer Vernooij
Add other_branch argument to Merge3Merger.
773
        self.other_branch = other_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
774
        self._raw_conflicts = []
775
        self.cooked_conflicts = []
776
        self.reprocess = reprocess
777
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
778
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
779
        # Uncommenting this will change the default algorithm to always use
780
        # _entries_lca. This can be useful for running the test suite and
781
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
782
        # if lca_trees is None:
783
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
784
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
785
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
786
        if do_merge:
787
            self.do_merge()
4961.2.12 by Martin Pool
Further pb/pp removals
788
        if pp is not None:
789
            warnings.warn("pp argument to Merge3Merger is deprecated")
790
        if pb is not None:
791
            warnings.warn("pb argument to Merge3Merger is deprecated")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
792
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
793
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
794
        operation = cleanup.OperationWithCleanups(self._do_merge)
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
795
        self.working_tree.lock_tree_write()
796
        operation.add_cleanup(self.working_tree.unlock)
797
        self.this_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
798
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
799
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
800
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
801
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
802
        operation.add_cleanup(self.other_tree.unlock)
803
        operation.run()
804
805
    def _do_merge(self, operation):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
806
        self.tt = transform.TreeTransform(self.working_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
807
        operation.add_cleanup(self.tt.finalize)
808
        self._compute_transform()
809
        results = self.tt.apply(no_conflicts=True)
810
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
811
        try:
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
812
            self.working_tree.add_conflicts(self.cooked_conflicts)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
813
        except errors.UnsupportedOperation:
814
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
815
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
816
    def make_preview_transform(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
817
        operation = cleanup.OperationWithCleanups(self._make_preview_transform)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
818
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
819
        operation.add_cleanup(self.base_tree.unlock)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
820
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
821
        operation.add_cleanup(self.other_tree.unlock)
822
        return operation.run_simple()
823
824
    def _make_preview_transform(self):
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
825
        self.tt = transform.TransformPreview(self.working_tree)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
826
        self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
827
        return self.tt
828
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
829
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
830
        if self._lca_trees is None:
831
            entries = self._entries3()
832
            resolver = self._three_way
833
        else:
834
            entries = self._entries_lca()
835
            resolver = self._lca_multi_way
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
836
        # Prepare merge hooks
837
        factories = Merger.hooks['merge_file_content']
838
        # One hook for each registered one plus our default merger
839
        hooks = [factory(self) for factory in factories] + [self]
840
        self.active_hooks = [hook for hook in hooks if hook is not None]
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
841
        child_pb = ui.ui_factory.nested_progress_bar()
842
        try:
843
            for num, (file_id, changed, parents3, names3,
844
                      executable3) in enumerate(entries):
6282.3.1 by Vincent Ladeuil
First cut at a working plugin to avoid conflicts in .po files by shelling out to msgmerge.
845
                # Try merging each entry
846
                child_pb.update(gettext('Preparing file merge'),
847
                                num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
848
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
849
                if changed:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
850
                    file_status = self._do_merge_contents(file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
851
                else:
852
                    file_status = 'unmodified'
853
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
854
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
855
        finally:
856
            child_pb.finished()
5993.2.4 by Jelmer Vernooij
Remove feature flag.
857
        self.tt.fixup_new_roots()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
858
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
859
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
860
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
861
        """Finalize the transform and report the changes.
862
863
        This is the second half of _compute_transform.
864
        """
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
865
        child_pb = ui.ui_factory.nested_progress_bar()
866
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
867
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
868
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
869
        finally:
870
            child_pb.finished()
871
        if self.change_reporter is not None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
872
            from breezy import delta
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
873
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
874
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
875
        self.cook_conflicts(fs_conflicts)
876
        for conflict in self.cooked_conflicts:
5898.1.6 by Martin
Avoid implicit str casting in trace methods by calling unicode() on conflict objects first
877
            trace.warning(unicode(conflict))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
878
2590.2.4 by Aaron Bentley
Move entry generation to a helper
879
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
880
        """Gather data about files modified between three trees.
881
882
        Return a list of tuples of file_id, changed, parents3, names3,
883
        executable3.  changed is a boolean indicating whether the file contents
884
        or kind were changed.  parents3 is a tuple of parent ids for base,
885
        other and this.  names3 is a tuple of names for base, other and this.
886
        executable3 is a tuple of execute-bit values for base, other and this.
887
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
888
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
889
        iterator = self.other_tree.iter_changes(self.base_tree,
5783.2.1 by John Arbash Meinel
Remove the 'include_unchanged=True' from iter_changes.
890
                specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
891
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
892
        this_entries = dict((e.file_id, e) for p, e in
893
                            self.this_tree.iter_entries_by_dir(
894
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
895
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
896
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
897
            if (self.interesting_ids is not None and
898
                file_id not in self.interesting_ids):
899
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
900
            entry = this_entries.get(file_id)
901
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
902
                this_name = entry.name
903
                this_parent = entry.parent_id
904
                this_executable = entry.executable
905
            else:
906
                this_name = None
907
                this_parent = None
908
                this_executable = None
909
            parents3 = parents + (this_parent,)
910
            names3 = names + (this_name,)
911
            executable3 = executable + (this_executable,)
912
            result.append((file_id, changed, parents3, names3, executable3))
913
        return result
914
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
915
    def _entries_lca(self):
916
        """Gather data about files modified between multiple trees.
917
918
        This compares OTHER versus all LCA trees, and for interesting entries,
919
        it then compares with THIS and BASE.
920
921
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
922
923
        :return: [(file_id, changed, parents, names, executable)], where:
924
925
            * file_id: Simple file_id of the entry
926
            * changed: Boolean, True if the kind or contents changed else False
927
            * parents: ((base, [parent_id, in, lcas]), parent_id_other,
928
                        parent_id_this)
929
            * names:   ((base, [name, in, lcas]), name_in_other, name_in_this)
930
            * executable: ((base, [exec, in, lcas]), exec_in_other,
931
                        exec_in_this)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
932
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
933
        if self.interesting_files is not None:
934
            lookup_trees = [self.this_tree, self.base_tree]
935
            lookup_trees.extend(self._lca_trees)
936
            # I think we should include the lca trees as well
937
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
938
                                                        lookup_trees)
939
        else:
940
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
941
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
942
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
943
6405.2.10 by Jelmer Vernooij
Fix more tests.
944
        base_inventory = self.base_tree.root_inventory
945
        this_inventory = self.this_tree.root_inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
946
        for path, file_id, other_ie, lca_values in walker.iter_all():
947
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
948
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
949
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
950
            if interesting_ids is not None and file_id not in interesting_ids:
951
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
952
3514.4.30 by John Arbash Meinel
Several updates.
953
            # If other_revision is found in any of the lcas, that means this
954
            # node is uninteresting. This is because when merging, if there are
955
            # multiple heads(), we have to create a new node. So if we didn't,
956
            # we know that the ancestry is linear, and that OTHER did not
957
            # modify anything
958
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
959
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
960
            if other_revision is not None:
961
                # We can't use this shortcut when other_revision is None,
962
                # because it may be None because things are WorkingTrees, and
963
                # not because it is *actually* None.
964
                is_unmodified = False
965
                for lca_path, ie in lca_values:
966
                    if ie is not None and ie.revision == other_revision:
967
                        is_unmodified = True
968
                        break
969
                if is_unmodified:
970
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
971
972
            lca_entries = []
973
            for lca_path, lca_ie in lca_values:
974
                if lca_ie is None:
975
                    lca_entries.append(_none_entry)
976
                else:
977
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
978
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
979
            if base_inventory.has_id(file_id):
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
980
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
981
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
982
                base_ie = _none_entry
983
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
984
            if this_inventory.has_id(file_id):
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
985
                this_ie = this_inventory[file_id]
986
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
987
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
988
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
989
            lca_kinds = []
990
            lca_parent_ids = []
991
            lca_names = []
992
            lca_executable = []
993
            for lca_ie in lca_entries:
994
                lca_kinds.append(lca_ie.kind)
995
                lca_parent_ids.append(lca_ie.parent_id)
996
                lca_names.append(lca_ie.name)
997
                lca_executable.append(lca_ie.executable)
998
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
999
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1000
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1001
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1002
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1003
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1004
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1005
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1006
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1007
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1008
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1009
            content_changed = True
1010
            if kind_winner == 'this':
1011
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1012
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1013
                    if parent_id_winner == 'this' and name_winner == 'this':
1014
                        # No change for this directory in OTHER, skip
1015
                        continue
1016
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1017
                elif other_ie.kind is None or other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1018
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1019
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1020
                            return None
1021
                        return tree.get_file_sha1(file_id)
1022
                    base_sha1 = get_sha1(base_ie, self.base_tree)
1023
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
1024
                                 in zip(lca_entries, self._lca_trees)]
1025
                    this_sha1 = get_sha1(this_ie, self.this_tree)
1026
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1027
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1028
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1029
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1030
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1031
                        (base_ie.executable, lca_executable),
1032
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1033
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1034
                        and sha1_winner == 'this' and exec_winner == 'this'):
1035
                        # No kind, parent, name, exec, or content change for
1036
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1037
                        continue
1038
                    if sha1_winner == 'this':
1039
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1040
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1041
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1042
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1043
                            return None
1044
                        return tree.get_symlink_target(file_id)
1045
                    base_target = get_target(base_ie, self.base_tree)
1046
                    lca_targets = [get_target(ie, tree) for ie, tree
1047
                                   in zip(lca_entries, self._lca_trees)]
1048
                    this_target = get_target(this_ie, self.this_tree)
1049
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1050
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1051
                        (base_target, lca_targets),
1052
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1053
                    if (parent_id_winner == 'this' and name_winner == 'this'
1054
                        and target_winner == 'this'):
1055
                        # No kind, parent, name, or symlink target change
1056
                        # not interesting
1057
                        continue
1058
                    if target_winner == 'this':
1059
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1060
                elif other_ie.kind == 'tree-reference':
1061
                    # The 'changed' information seems to be handled at a higher
1062
                    # level. At least, _entries3 returns False for content
1063
                    # changed, even when at a new revision_id.
1064
                    content_changed = False
1065
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1066
                        # Nothing interesting
1067
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1068
                else:
1069
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1070
1071
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1072
            result.append((file_id, content_changed,
1073
                           ((base_ie.parent_id, lca_parent_ids),
1074
                            other_ie.parent_id, this_ie.parent_id),
1075
                           ((base_ie.name, lca_names),
1076
                            other_ie.name, this_ie.name),
1077
                           ((base_ie.executable, lca_executable),
1078
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1079
                          ))
1080
        return result
1081
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1082
    def write_modified(self, results):
1083
        modified_hashes = {}
1084
        for path in results.modified_paths:
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
1085
            file_id = self.working_tree.path2id(self.working_tree.relpath(path))
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1086
            if file_id is None:
1087
                continue
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
1088
            hash = self.working_tree.get_file_sha1(file_id)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1089
            if hash is None:
1090
                continue
1091
            modified_hashes[file_id] = hash
6410.1.2 by Jelmer Vernooij
Distinguish working tree and this tree.
1092
        self.working_tree.set_merge_modified(modified_hashes)
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1093
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1094
    @staticmethod
1095
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1096
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1097
        if entry is None:
1098
            return None
1099
        return entry.parent_id
1100
1101
    @staticmethod
1102
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1103
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1104
        if entry is None:
1105
            return None
1106
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1107
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1108
    @staticmethod
1109
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1110
        """Determine the sha1 of the file contents (used as a key method)."""
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
1111
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1112
            return None
1113
        return tree.get_file_sha1(file_id)
1114
1115
    @staticmethod
1116
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1117
        """Determine the executability of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1118
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1119
            return None
1120
        if tree.kind(file_id) != "file":
1121
            return False
1122
        return tree.is_executable(file_id)
1123
1124
    @staticmethod
1125
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1126
        """Determine the kind of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1127
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1128
            return None
1129
        return tree.kind(file_id)
1130
1131
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1132
    def _three_way(base, other, this):
1133
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1134
            # if 'base == other', either they all agree, or only 'this' has
1135
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1136
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1137
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1138
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1139
            return 'conflict'
1140
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1141
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1142
            return "this"
1143
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1144
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1145
            return "other"
1146
1147
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1148
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1149
        """Consider LCAs when determining whether a change has occurred.
1150
1151
        If LCAS are all identical, this is the same as a _three_way comparison.
1152
1153
        :param bases: value in (BASE, [LCAS])
1154
        :param other: value in OTHER
1155
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1156
        :param allow_overriding_lca: If there is more than one unique lca
1157
            value, allow OTHER to override THIS if it has a new value, and
1158
            THIS only has an lca value, or vice versa. This is appropriate for
1159
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1160
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1161
            changed or not.
1162
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1163
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1164
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1165
        if other == this:
1166
            # Either Ambiguously clean, or nothing was actually changed. We
1167
            # don't really care
1168
            return 'this'
1169
        base_val, lca_vals = bases
1170
        # Remove 'base_val' from the lca_vals, because it is not interesting
1171
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1172
                                      if lca_val != base_val]
1173
        if len(filtered_lca_vals) == 0:
1174
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1175
1176
        unique_lca_vals = set(filtered_lca_vals)
1177
        if len(unique_lca_vals) == 1:
1178
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1179
1180
        if allow_overriding_lca:
1181
            if other in unique_lca_vals:
1182
                if this in unique_lca_vals:
1183
                    # Each side picked a different lca, conflict
1184
                    return 'conflict'
1185
                else:
1186
                    # This has a value which supersedes both lca values, and
1187
                    # other only has an lca value
1188
                    return 'this'
1189
            elif this in unique_lca_vals:
1190
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1191
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1192
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1193
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1194
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1195
        return 'conflict'
1196
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1197
    def merge_names(self, file_id):
1198
        def get_entry(tree):
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1199
            try:
6405.2.10 by Jelmer Vernooij
Fix more tests.
1200
                return tree.root_inventory[file_id]
6468.2.4 by Jelmer Vernooij
Ask for forgiveness, not permission when looking up tree entry.
1201
            except errors.NoSuchId:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1202
                return None
1203
        this_entry = get_entry(self.this_tree)
1204
        other_entry = get_entry(self.other_tree)
1205
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1206
        entries = (base_entry, other_entry, this_entry)
1207
        names = []
1208
        parents = []
1209
        for entry in entries:
1210
            if entry is None:
1211
                names.append(None)
1212
                parents.append(None)
1213
            else:
1214
                names.append(entry.name)
1215
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1216
        return self._merge_names(file_id, parents, names,
1217
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1218
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1219
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1220
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1221
        base_name, other_name, this_name = names
1222
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1223
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1224
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1225
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1226
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1227
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1228
            if name_winner == "this":
1229
                name_winner = "other"
1230
            if parent_id_winner == "this":
1231
                parent_id_winner = "other"
1232
        if name_winner == "this" and parent_id_winner == "this":
1233
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1234
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1235
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1236
            # road if a ContentConflict needs to be created so we should not do
1237
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1238
            trans_id = self.tt.trans_id_file_id(file_id)
1239
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1240
                                        this_parent, this_name,
1241
                                        other_parent, other_name))
5954.4.2 by Aaron Bentley
Support merging into null tree.
1242
        if not self.other_tree.has_id(file_id):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1243
            # it doesn't matter whether the result was 'other' or
5954.4.6 by Aaron Bentley
Updates from review.
1244
            # 'conflict'-- if it has no file id, we leave it alone.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1245
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1246
        parent_id = parents[self.winner_idx[parent_id_winner]]
5954.4.2 by Aaron Bentley
Support merging into null tree.
1247
        name = names[self.winner_idx[name_winner]]
1248
        if parent_id is not None or name is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1249
            # if we get here, name_winner and parent_winner are set to safe
1250
            # values.
5954.4.2 by Aaron Bentley
Support merging into null tree.
1251
            if parent_id is None and name is not None:
1252
                # if parent_id is None and name is non-None, current file is
1253
                # the tree root.
1254
                if names[self.winner_idx[parent_id_winner]] != '':
1255
                    raise AssertionError(
1256
                        'File looks like a root, but named %s' %
1257
                        names[self.winner_idx[parent_id_winner]])
1258
                parent_trans_id = transform.ROOT_PARENT
1259
            else:
1260
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1261
            self.tt.adjust_path(name, parent_trans_id,
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1262
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1263
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1264
    def _do_merge_contents(self, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1265
        """Performs a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1266
        def contents_pair(tree):
5967.7.1 by Martin Pool
Deprecate __contains__ on Tree and Inventory
1267
            if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1268
                return (None, None)
1269
            kind = tree.kind(file_id)
1270
            if kind == "file":
1271
                contents = tree.get_file_sha1(file_id)
1272
            elif kind == "symlink":
1273
                contents = tree.get_symlink_target(file_id)
1274
            else:
1275
                contents = None
1276
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1277
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1278
        # See SPOT run.  run, SPOT, run.
1279
        # So we're not QUITE repeating ourselves; we do tricky things with
1280
        # file kind...
1281
        base_pair = contents_pair(self.base_tree)
1282
        other_pair = contents_pair(self.other_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1283
        if self._lca_trees:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1284
            this_pair = contents_pair(self.this_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1285
            lca_pairs = [contents_pair(tree) for tree in self._lca_trees]
1286
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1287
                                         this_pair, allow_overriding_lca=False)
1288
        else:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1289
            if base_pair == other_pair:
1290
                winner = 'this'
1291
            else:
1292
                # We delayed evaluating this_pair as long as we can to avoid
1293
                # unnecessary sha1 calculation
1294
                this_pair = contents_pair(self.this_tree)
1295
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1296
        if winner == 'this':
1297
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1298
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1299
        # We have a hypothetical conflict, but if we have files, then we
1300
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1301
        trans_id = self.tt.trans_id_file_id(file_id)
6388.1.3 by Jelmer Vernooij
Add pre and post merge hooks.
1302
        params = MergeFileHookParams(self, file_id, trans_id, this_pair[0],
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1303
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1304
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1305
        hook_status = 'not_applicable'
1306
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1307
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1308
            if hook_status != 'not_applicable':
1309
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1310
                break
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1311
        # If the merge ends up replacing the content of the file, we get rid of
1312
        # it at the end of this method (this variable is used to track the
1313
        # exceptions to this rule).
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1314
        keep_this = False
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1315
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1316
        if hook_status == 'not_applicable':
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1317
            # No merge hook was able to resolve the situation. Two cases exist:
1318
            # a content conflict or a duplicate one.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1319
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1320
            name = self.tt.final_name(trans_id)
1321
            parent_id = self.tt.final_parent(trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1322
            duplicate = False
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1323
            inhibit_content_conflict = False
1324
            if params.this_kind is None: # file_id is not in THIS
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1325
                # Is the name used for a different file_id ?
1326
                dupe_path = self.other_tree.id2path(file_id)
1327
                this_id = self.this_tree.path2id(dupe_path)
6015.47.5 by Vincent Ladeuil
Fix the other half by also producing a conflict but rely on merge to create the appropriate content. This covers the case where a file is modified in THIS but replaced in OTHER
1328
                if this_id is not None:
1329
                    # Two entries for the same path
1330
                    keep_this = True
1331
                    # versioning the merged file will trigger a duplicate
1332
                    # conflict
1333
                    self.tt.version_file(file_id, trans_id)
1334
                    transform.create_from_tree(
1335
                        self.tt, trans_id, self.other_tree, file_id,
1336
                        filter_tree_path=self._get_filter_tree_path(file_id))
1337
                    inhibit_content_conflict = True
1338
            elif params.other_kind is None: # file_id is not in OTHER
1339
                # Is the name used for a different file_id ?
1340
                dupe_path = self.this_tree.id2path(file_id)
1341
                other_id = self.other_tree.path2id(dupe_path)
1342
                if other_id is not None:
1343
                    # Two entries for the same path again, but here, the other
1344
                    # entry will also be merged.  We simply inhibit the
1345
                    # 'content' conflict creation because we know OTHER will
1346
                    # create (or has already created depending on ordering) an
1347
                    # entry at the same path. This will trigger a 'duplicate'
1348
                    # conflict later.
1349
                    keep_this = True
1350
                    inhibit_content_conflict = True
1351
            if not inhibit_content_conflict:
1352
                if params.this_kind is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1353
                    self.tt.unversion_file(trans_id)
1354
                # This is a contents conflict, because none of the available
1355
                # functions could merge it.
1356
                file_group = self._dump_conflicts(name, parent_id, file_id,
1357
                                                  set_version=True)
1358
                self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1359
        elif hook_status == 'success':
1360
            self.tt.create_file(lines, trans_id)
1361
        elif hook_status == 'conflicted':
1362
            # XXX: perhaps the hook should be able to provide
1363
            # the BASE/THIS/OTHER files?
1364
            self.tt.create_file(lines, trans_id)
1365
            self._raw_conflicts.append(('text conflict', trans_id))
1366
            name = self.tt.final_name(trans_id)
1367
            parent_id = self.tt.final_parent(trans_id)
4869.3.23 by Andrew Bennetts
Remove some confusing code that has no effect.
1368
            self._dump_conflicts(name, parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1369
        elif hook_status == 'delete':
1370
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1371
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1372
        elif hook_status == 'done':
1373
            # The hook function did whatever it needs to do directly, no
1374
            # further action needed here.
1375
            pass
1376
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1377
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1378
        if not self.this_tree.has_id(file_id) and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1379
            self.tt.version_file(file_id, trans_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1380
        if not keep_this:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1381
            # The merge has been performed and produced a new content, so the
1382
            # old contents should not be retained.
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1383
            self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1384
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1385
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1386
    def _default_other_winner_merge(self, merge_hook_params):
1387
        """Replace this contents with other."""
1388
        file_id = merge_hook_params.file_id
1389
        trans_id = merge_hook_params.trans_id
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1390
        if self.other_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1391
            # OTHER changed the file
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1392
            transform.create_from_tree(
1393
                self.tt, trans_id, self.other_tree, file_id,
1394
                filter_tree_path=self._get_filter_tree_path(file_id))
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1395
            return 'done', None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1396
        elif self.this_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1397
            # OTHER deleted the file
1398
            return 'delete', None
1399
        else:
1400
            raise AssertionError(
1401
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1402
                % (file_id,))
1403
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1404
    def merge_contents(self, merge_hook_params):
1405
        """Fallback merge logic after user installed hooks."""
1406
        # This function is used in merge hooks as the fallback instance.
1407
        # Perhaps making this function and the functions it calls be a 
1408
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1409
        if merge_hook_params.winner == 'other':
1410
            # OTHER is a straight winner, so replace this contents with other
1411
            return self._default_other_winner_merge(merge_hook_params)
1412
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1413
            # THIS and OTHER are both files, so text merge.  Either
1414
            # BASE is a file, or both converted to files, so at least we
1415
            # have agreement that output should be a file.
1416
            try:
1417
                self.text_merge(merge_hook_params.file_id,
1418
                    merge_hook_params.trans_id)
1419
            except errors.BinaryFile:
1420
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1421
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1422
        else:
1423
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1424
1425
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1426
        """Return the lines in a file, or an empty list."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1427
        if tree.has_id(file_id):
4708.2.1 by Martin
Ensure all files opened by bazaar proper are explicitly closed
1428
            return tree.get_file_lines(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1429
        else:
1430
            return []
1431
1432
    def text_merge(self, file_id, trans_id):
1433
        """Perform a three-way text merge on a file_id"""
1434
        # it's possible that we got here with base as a different type.
1435
        # if so, we just want two-way text conflicts.
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1436
        if self.base_tree.has_id(file_id) and \
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1437
            self.base_tree.kind(file_id) == "file":
1438
            base_lines = self.get_lines(self.base_tree, file_id)
1439
        else:
1440
            base_lines = []
1441
        other_lines = self.get_lines(self.other_tree, file_id)
1442
        this_lines = self.get_lines(self.this_tree, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1443
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1444
                           is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1445
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1446
        if self.show_base is True:
1447
            base_marker = '|' * 7
1448
        else:
1449
            base_marker = None
1450
1451
        def iter_merge3(retval):
1452
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1453
            for line in m3.merge_lines(name_a = "TREE",
1454
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1455
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1456
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1457
                                       base_marker=base_marker,
1458
                                       reprocess=self.reprocess):
1459
                if line.startswith(start_marker):
1460
                    retval["text_conflicts"] = True
1461
                    yield line.replace(start_marker, '<' * 7)
1462
                else:
1463
                    yield line
1464
        retval = {}
1465
        merge3_iterator = iter_merge3(retval)
1466
        self.tt.create_file(merge3_iterator, trans_id)
1467
        if retval["text_conflicts"] is True:
1468
            self._raw_conflicts.append(('text conflict', trans_id))
1469
            name = self.tt.final_name(trans_id)
1470
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1471
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1472
                                              this_lines, base_lines,
1473
                                              other_lines)
1474
            file_group.append(trans_id)
1475
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1476
1477
    def _get_filter_tree_path(self, file_id):
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1478
        if self.this_tree.supports_content_filtering():
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1479
            # We get the path from the working tree if it exists.
1480
            # That fails though when OTHER is adding a file, so
1481
            # we fall back to the other tree to find the path if
1482
            # it doesn't exist locally.
1483
            try:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1484
                return self.this_tree.id2path(file_id)
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1485
            except errors.NoSuchId:
6015.47.8 by Vincent Ladeuil
Address some points from gz's review.
1486
                return self.other_tree.id2path(file_id)
1487
        # Skip the id2path lookup for older formats
1488
        return None
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1489
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1490
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1491
                        base_lines=None, other_lines=None, set_version=False,
1492
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1493
        """Emit conflict files.
1494
        If this_lines, base_lines, or other_lines are omitted, they will be
1495
        determined automatically.  If set_version is true, the .OTHER, .THIS
1496
        or .BASE (in that order) will be created as versioned files.
1497
        """
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1498
        data = [('OTHER', self.other_tree, other_lines),
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1499
                ('THIS', self.this_tree, this_lines)]
1500
        if not no_base:
1501
            data.append(('BASE', self.base_tree, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1502
1503
        # We need to use the actual path in the working tree of the file here,
1504
        # ignoring the conflict suffixes
1505
        wt = self.this_tree
1506
        if wt.supports_content_filtering():
1507
            try:
1508
                filter_tree_path = wt.id2path(file_id)
1509
            except errors.NoSuchId:
1510
                # file has been deleted
1511
                filter_tree_path = None
1512
        else:
1513
            # Skip the id2path lookup for older formats
1514
            filter_tree_path = None
1515
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1516
        versioned = False
1517
        file_group = []
1518
        for suffix, tree, lines in data:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1519
            if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1520
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1521
                                               suffix, lines, filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1522
                file_group.append(trans_id)
1523
                if set_version and not versioned:
1524
                    self.tt.version_file(file_id, trans_id)
1525
                    versioned = True
1526
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1527
3363.17.21 by Aaron Bentley
Conflicts are handled when merging from preview trees
1528
    def _conflict_file(self, name, parent_id, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1529
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1530
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1531
        name = name + '.' + suffix
1532
        trans_id = self.tt.create_path(name, parent_id)
4854.1.1 by Andrew Bennetts
Merge lp:bzr/2.0 into lp:bzr.
1533
        transform.create_from_tree(self.tt, trans_id, tree, file_id, lines,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1534
            filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1535
        return trans_id
1536
1537
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1538
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1539
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1540
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1541
        self._merge_executable(file_id, executable, file_status,
1542
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1543
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1544
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1545
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1546
        """Perform a merge on the execute bit."""
1547
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1548
        if file_status == "deleted":
1549
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1550
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1551
        if winner == "conflict":
1552
        # There must be a None in here, if we have a conflict, but we
1553
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1554
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1555
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1556
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1557
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1558
        if winner == 'this' and file_status != "modified":
1559
            return
1560
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1561
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1562
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1563
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1564
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1565
        else:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1566
            if self.other_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1567
                executability = other_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1568
            elif self.this_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1569
                executability = this_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1570
            elif self.base_tree_has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1571
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1572
        if executability is not None:
1573
            trans_id = self.tt.trans_id_file_id(file_id)
1574
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1575
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1576
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1577
        """Convert all conflicts into a form that doesn't depend on trans_id"""
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1578
        content_conflict_file_ids = set()
1579
        cooked_conflicts = transform.cook_conflicts(fs_conflicts, self.tt)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1580
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1581
        for conflict in self._raw_conflicts:
1582
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1583
            if conflict_type == 'path conflict':
1584
                (trans_id, file_id,
1585
                this_parent, this_name,
1586
                other_parent, other_name) = conflict[1:]
1587
                if this_parent is None or this_name is None:
1588
                    this_path = '<deleted>'
1589
                else:
1590
                    parent_path =  fp.get_path(
1591
                        self.tt.trans_id_file_id(this_parent))
1592
                    this_path = osutils.pathjoin(parent_path, this_name)
1593
                if other_parent is None or other_name is None:
1594
                    other_path = '<deleted>'
1595
                else:
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1596
                    if other_parent == self.other_tree.get_root_id():
5050.73.9 by Vincent Ladeuil
Fix typo.
1597
                        # The tree transform doesn't know about the other root,
5050.73.8 by Vincent Ladeuil
Handle path conflicts involving different root-ids
1598
                        # so we special case here to avoid a NoFinalPath
1599
                        # exception
1600
                        parent_path = ''
1601
                    else:
1602
                        parent_path =  fp.get_path(
1603
                            self.tt.trans_id_file_id(other_parent))
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1604
                    other_path = osutils.pathjoin(parent_path, other_name)
1605
                c = _mod_conflicts.Conflict.factory(
1606
                    'path conflict', path=this_path,
1607
                    conflict_path=other_path,
1608
                    file_id=file_id)
1609
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1610
                for trans_id in conflict[1]:
1611
                    file_id = self.tt.final_file_id(trans_id)
1612
                    if file_id is not None:
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1613
                        # Ok we found the relevant file-id
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1614
                        break
1615
                path = fp.get_path(trans_id)
1616
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1617
                    if path.endswith(suffix):
6015.47.4 by Vincent Ladeuil
Fix first half of the bug by producing a 'duplicate' conflict instead of a 'content' one when the file has been replaced in THIS and modified in OTHER.
1618
                        # Here is the raw path
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1619
                        path = path[:-len(suffix)]
1620
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1621
                c = _mod_conflicts.Conflict.factory(conflict_type,
1622
                                                    path=path, file_id=file_id)
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1623
                content_conflict_file_ids.add(file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1624
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1625
                trans_id = conflict[1]
1626
                path = fp.get_path(trans_id)
1627
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1628
                c = _mod_conflicts.Conflict.factory(conflict_type,
1629
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1630
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1631
                raise AssertionError('bad conflict type: %r' % (conflict,))
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1632
            cooked_conflicts.append(c)
5988.2.2 by Vincent Ladeuil
Make it clear that we start from an empty cooked_conflicts list.
1633
1634
        self.cooked_conflicts = []
5988.2.1 by Vincent Ladeuil
Do not generate path conflicts if a corresponding content conflict exists
1635
        # We want to get rid of path conflicts when a corresponding contents
1636
        # conflict exists. This can occur when one branch deletes a file while
1637
        # the other renames *and* modifies it. In this case, the content
1638
        # conflict is enough.
1639
        for c in cooked_conflicts:
1640
            if (c.typestring == 'path conflict'
1641
                and c.file_id in content_conflict_file_ids):
1642
                continue
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1643
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1644
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1645
1646
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1647
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1648
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1649
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1650
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1651
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1652
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1653
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1654
    def _generate_merge_plan(self, file_id, base):
1655
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1656
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1657
1658
    def _merged_lines(self, file_id):
1659
        """Generate the merged lines.
1660
        There is no distinction between lines that are meant to contain <<<<<<<
1661
        and conflicts.
1662
        """
1663
        if self.cherrypick:
1664
            base = self.base_tree
1665
        else:
1666
            base = None
1667
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1668
        if 'merge' in debug.debug_flags:
1669
            plan = list(plan)
1670
            trans_id = self.tt.trans_id_file_id(file_id)
1671
            name = self.tt.final_name(trans_id) + '.plan'
4634.101.6 by John Arbash Meinel
killed-both and killed-base is 11 chars long.
1672
            contents = ('%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1673
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1674
        textmerge = versionedfile.PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1675
                                                 '>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1676
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1677
        if conflicts:
1678
            base_lines = textmerge.base_from_plan()
1679
        else:
1680
            base_lines = None
1681
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1682
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1683
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1684
        """Perform a (weave) text merge for a given file and file-id.
1685
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1686
        and a conflict will be noted.
1687
        """
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1688
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1689
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1690
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1691
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1692
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1693
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1694
        if base_lines is not None:
1695
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1696
            self._raw_conflicts.append(('text conflict', trans_id))
1697
            name = self.tt.final_name(trans_id)
1698
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1699
            file_group = self._dump_conflicts(name, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1700
                                              no_base=False,
1701
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1702
            file_group.append(trans_id)
1703
1704
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1705
class LCAMerger(WeaveMerger):
1706
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1707
    def _generate_merge_plan(self, file_id, base):
1708
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1709
                                                  base=base)
1710
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1711
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1712
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1713
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1714
    def dump_file(self, temp_dir, name, tree, file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1715
        out_path = osutils.pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1716
        out_file = open(out_path, "wb")
1717
        try:
1718
            in_file = tree.get_file(file_id)
1719
            for line in in_file:
1720
                out_file.write(line)
1721
        finally:
1722
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1723
        return out_path
1724
1725
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1726
        """Perform a diff3 merge using a specified file-id and trans-id.
1727
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1728
        will be dumped, and a will be conflict noted.
1729
        """
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1730
        import breezy.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1731
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1732
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1733
            new_file = osutils.pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1734
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1735
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1736
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1737
            status = breezy.patch.diff3(new_file, this, base, other)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1738
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1739
                raise errors.BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1740
            f = open(new_file, 'rb')
1741
            try:
1742
                self.tt.create_file(f, trans_id)
1743
            finally:
1744
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1745
            if status == 1:
1746
                name = self.tt.final_name(trans_id)
1747
                parent_id = self.tt.final_parent(trans_id)
1748
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1749
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1750
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1751
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1752
1753
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1754
class PathNotInTree(errors.BzrError):
1755
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1756
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1757
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1758
    def __init__(self, path, tree):
1759
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1760
1761
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1762
class MergeIntoMerger(Merger):
1763
    """Merger that understands other_tree will be merged into a subdir.
1764
1765
    This also changes the Merger api so that it uses real Branch, revision_id,
1766
    and RevisonTree objects, rather than using revision specs.
1767
    """
1768
1769
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
5246.2.22 by Andrew Bennetts
Minor tweaks.
1770
            source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1771
        """Create a new MergeIntoMerger object.
1772
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1773
        source_subpath in other_tree will be effectively copied to
1774
        target_subdir in this_tree.
1775
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1776
        :param this_tree: The tree that we will be merging into.
1777
        :param other_branch: The Branch we will be merging from.
1778
        :param other_tree: The RevisionTree object we want to merge.
1779
        :param target_subdir: The relative path where we want to merge
1780
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1781
        :param source_subpath: The relative path specifying the subtree of
1782
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1783
        """
1784
        # It is assumed that we are merging a tree that is not in our current
1785
        # ancestry, which means we are using the "EmptyTree" as our basis.
1786
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
1787
                                _mod_revision.NULL_REVISION)
1788
        super(MergeIntoMerger, self).__init__(
1789
            this_branch=this_tree.branch,
1790
            this_tree=this_tree,
1791
            other_tree=other_tree,
1792
            base_tree=null_ancestor_tree,
1793
            )
1794
        self._target_subdir = target_subdir
1795
        self._source_subpath = source_subpath
1796
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1797
        if other_rev_id is None:
1798
            other_rev_id = other_tree.get_revision_id()
1799
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1800
        self.base_is_ancestor = True
1801
        self.backup_files = True
1802
        self.merge_type = Merge3Merger
1803
        self.show_base = False
1804
        self.reprocess = False
1805
        self.interesting_ids = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1806
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
1807
              target_subdir=self._target_subdir,
1808
              source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1809
        if self._source_subpath != '':
1810
            # If this isn't a partial merge make sure the revisions will be
1811
            # present.
1812
            self._maybe_fetch(self.other_branch, self.this_branch,
1813
                self.other_basis)
1814
1815
    def set_pending(self):
1816
        if self._source_subpath != '':
1817
            return
1818
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1819
1820
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1821
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1822
    """Wrap a merge-type class to provide extra parameters.
1823
    
1824
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1825
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1826
    the 'merge_type' member.  It is difficult override do_merge without
1827
    re-writing the whole thing, so instead we create a wrapper which will pass
1828
    the extra parameters.
1829
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1830
1831
    def __init__(self, merge_type, **kwargs):
1832
        self._extra_kwargs = kwargs
1833
        self._merge_type = merge_type
1834
1835
    def __call__(self, *args, **kwargs):
1836
        kwargs.update(self._extra_kwargs)
1837
        return self._merge_type(*args, **kwargs)
1838
1839
    def __getattr__(self, name):
1840
        return getattr(self._merge_type, name)
1841
1842
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1843
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1844
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1845
1846
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1847
        """Initialize the merger object.
1848
1849
        :param args: See Merge3Merger.__init__'s args.
1850
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1851
            source_subpath and target_subdir.
1852
        :keyword source_subpath: The relative path specifying the subtree of
1853
            other_tree to merge into this_tree.
1854
        :keyword target_subdir: The relative path where we want to merge
1855
            other_tree into this_tree
1856
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1857
        # All of the interesting work happens during Merge3Merger.__init__(),
1858
        # so we have have to hack in to get our extra parameters set.
1859
        self._source_subpath = kwargs.pop('source_subpath')
1860
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1861
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1862
1863
    def _compute_transform(self):
1864
        child_pb = ui.ui_factory.nested_progress_bar()
1865
        try:
1866
            entries = self._entries_to_incorporate()
1867
            entries = list(entries)
1868
            for num, (entry, parent_id) in enumerate(entries):
6138.4.1 by Jonathan Riddell
add gettext to progress bar strings
1869
                child_pb.update(gettext('Preparing file merge'), num, len(entries))
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1870
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1871
                trans_id = transform.new_by_entry(self.tt, entry,
1872
                    parent_trans_id, self.other_tree)
1873
        finally:
1874
            child_pb.finished()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1875
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1876
1877
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1878
        """Yields pairs of (inventory_entry, new_parent)."""
6405.2.10 by Jelmer Vernooij
Fix more tests.
1879
        other_inv = self.other_tree.root_inventory
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1880
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1881
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1882
            # XXX: The error would be clearer if it gave the URL of the source
1883
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1884
            raise PathNotInTree(self._source_subpath, "Source tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1885
        subdir = other_inv[subdir_id]
1886
        parent_in_target = osutils.dirname(self._target_subdir)
6405.2.10 by Jelmer Vernooij
Fix more tests.
1887
        target_id = self.this_tree.path2id(parent_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1888
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1889
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1890
        name_in_target = osutils.basename(self._target_subdir)
1891
        merge_into_root = subdir.copy()
1892
        merge_into_root.name = name_in_target
6405.2.10 by Jelmer Vernooij
Fix more tests.
1893
        if self.this_tree.has_id(merge_into_root.file_id):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1894
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1895
            # This can happen fairly easily if the directory we are
1896
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1897
            # their root_id.  Users will expect this to Just Work, so we
1898
            # change the file-id here.
1899
            # Non-root file-ids could potentially conflict too.  That's really
1900
            # an edge case, so we don't do anything special for those.  We let
1901
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1902
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1903
        yield (merge_into_root, target_id)
5246.2.10 by Andrew Bennetts
Add more tests.
1904
        if subdir.kind != 'directory':
1905
            # No children, so we are done.
1906
            return
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1907
        for ignored_path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1908
            parent_id = entry.parent_id
1909
            if parent_id == subdir.file_id:
1910
                # The root's parent ID has changed, so make sure children of
1911
                # the root refer to the new ID.
1912
                parent_id = merge_into_root.file_id
1913
            yield (entry, parent_id)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1914
1915
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1916
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1917
                backup_files=False,
1918
                merge_type=Merge3Merger,
1919
                interesting_ids=None,
1920
                show_base=False,
1921
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1922
                other_rev_id=None,
1923
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1924
                this_tree=None,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
1925
                pb=None,
5993.2.4 by Jelmer Vernooij
Remove feature flag.
1926
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1927
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1928
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1929
    Typical use is probably::
1930
1931
        merge_inner(branch, branch.get_revision_tree(other_revision),
1932
                    branch.get_revision_tree(base_revision))
1933
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1934
    if this_tree is None:
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1935
        raise errors.BzrError("breezy.merge.merge_inner requires a this_tree "
5993.2.1 by Jelmer Vernooij
Add test for rootless tree merge.
1936
                              "parameter")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1937
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1938
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1939
    merger.backup_files = backup_files
1940
    merger.merge_type = merge_type
1941
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1942
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1943
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1944
        if interesting_ids:
1945
            raise ValueError('Only supply interesting_ids'
1946
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1947
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1948
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1949
    merger.reprocess = reprocess
1950
    merger.other_rev_id = other_rev_id
1951
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1952
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1953
    if get_revision_id is None:
1954
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1955
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1956
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1957
    return merger.do_merge()
1958
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1959
1960
merge_type_registry = registry.Registry()
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1961
merge_type_registry.register('diff3', Diff3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1962
                             "Merge using external diff3.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1963
merge_type_registry.register('lca', LCAMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1964
                             "LCA-newness merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1965
merge_type_registry.register('merge3', Merge3Merger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1966
                             "Native diff3-style merge.")
6259.3.2 by Martin Packman
No longer want register_lazy as passing objects directly
1967
merge_type_registry.register('weave', WeaveMerger,
6259.3.3 by Martin Packman
Merge bzr.dev to resolve conflicts with updated registry help strings
1968
                             "Weave-based merge.")
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1969
1970
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1971
def get_merge_type_registry():
6622.1.34 by Jelmer Vernooij
Rename brzlib => breezy.
1972
    """Merge type registry was previously in breezy.option
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1973
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1974
    This method provides a backwards compatible way to retrieve it.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1975
    """
6259.3.1 by Martin Packman
Relocate merge type registry to bzrlib.merge from bzrlib.option
1976
    return merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1977
1978
1979
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1980
    def status_a(revision, text):
1981
        if revision in ancestors_b:
1982
            return 'killed-b', text
1983
        else:
1984
            return 'new-a', text
1985
1986
    def status_b(revision, text):
1987
        if revision in ancestors_a:
1988
            return 'killed-a', text
1989
        else:
1990
            return 'new-b', text
1991
1992
    plain_a = [t for (a, t) in annotated_a]
1993
    plain_b = [t for (a, t) in annotated_b]
1994
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1995
    blocks = matcher.get_matching_blocks()
1996
    a_cur = 0
1997
    b_cur = 0
1998
    for ai, bi, l in blocks:
1999
        # process all mismatched sections
2000
        # (last mismatched section is handled because blocks always
2001
        # includes a 0-length last block)
2002
        for revision, text in annotated_a[a_cur:ai]:
2003
            yield status_a(revision, text)
2004
        for revision, text in annotated_b[b_cur:bi]:
2005
            yield status_b(revision, text)
2006
        # and now the matched section
2007
        a_cur = ai + l
2008
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
2009
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
2010
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2011
2012
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2013
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2014
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2015
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2016
        """Contructor.
2017
2018
        :param a_rev: Revision-id of one revision to merge
2019
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2020
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2021
        :param key_prefix: A prefix for accessing keys in vf, typically
2022
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2023
        """
2024
        self.a_rev = a_rev
2025
        self.b_rev = b_rev
2026
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2027
        self._last_lines = None
2028
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2029
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2030
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2031
        self._precache_tip_lines()
2032
2033
    def _precache_tip_lines(self):
2034
        lines = self.get_lines([self.a_rev, self.b_rev])
2035
        self.lines_a = lines[self.a_rev]
2036
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2037
2038
    def get_lines(self, revisions):
2039
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2040
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2041
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2042
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2043
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2044
        result = {}
2045
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2046
            if record.storage_kind == 'absent':
2047
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2048
            result[record.key[-1]] = osutils.chunks_to_lines(
2049
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2050
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2051
2052
    def plan_merge(self):
2053
        """Generate a 'plan' for merging the two revisions.
2054
2055
        This involves comparing their texts and determining the cause of
2056
        differences.  If text A has a line and text B does not, then either the
2057
        line was added to text A, or it was deleted from B.  Once the causes
2058
        are combined, they are written out in the format described in
2059
        VersionedFile.plan_merge
2060
        """
2061
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2062
        unique_a, unique_b = self._unique_lines(blocks)
2063
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2064
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2065
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2066
2067
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2068
        last_i = 0
2069
        last_j = 0
2070
        for i, j, n in blocks:
2071
            for a_index in range(last_i, i):
2072
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2073
                    if a_index in killed_b:
2074
                        yield 'conflicted-a', self.lines_a[a_index]
2075
                    else:
2076
                        yield 'new-a', self.lines_a[a_index]
2077
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2078
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2079
            for b_index in range(last_j, j):
2080
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2081
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2082
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2083
                    else:
2084
                        yield 'new-b', self.lines_b[b_index]
2085
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2086
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2087
            # handle common lines
2088
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2089
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2090
            last_i = i+n
2091
            last_j = j+n
2092
2093
    def _get_matching_blocks(self, left_revision, right_revision):
2094
        """Return a description of which sections of two revisions match.
2095
2096
        See SequenceMatcher.get_matching_blocks
2097
        """
3144.3.7 by Aaron Bentley
Update from review
2098
        cached = self._cached_matching_blocks.get((left_revision,
2099
                                                   right_revision))
2100
        if cached is not None:
2101
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2102
        if self._last_lines_revision_id == left_revision:
2103
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2104
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2105
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2106
            lines = self.get_lines([left_revision, right_revision])
2107
            left_lines = lines[left_revision]
2108
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2109
        self._last_lines = right_lines
2110
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2111
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2112
                                                       right_lines)
2113
        return matcher.get_matching_blocks()
2114
2115
    def _unique_lines(self, matching_blocks):
2116
        """Analyse matching_blocks to determine which lines are unique
2117
2118
        :return: a tuple of (unique_left, unique_right), where the values are
2119
            sets of line numbers of unique lines.
2120
        """
2121
        last_i = 0
2122
        last_j = 0
2123
        unique_left = []
2124
        unique_right = []
2125
        for i, j, n in matching_blocks:
2126
            unique_left.extend(range(last_i, i))
2127
            unique_right.extend(range(last_j, j))
2128
            last_i = i + n
2129
            last_j = j + n
2130
        return unique_left, unique_right
2131
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2132
    @staticmethod
2133
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2134
        """Remove changes from new_plan that came from old_plan.
2135
2136
        It is assumed that the difference between the old_plan and new_plan
2137
        is their choice of 'b' text.
2138
2139
        All lines from new_plan that differ from old_plan are emitted
2140
        verbatim.  All lines from new_plan that match old_plan but are
2141
        not about the 'b' revision are emitted verbatim.
2142
2143
        Lines that match and are about the 'b' revision are the lines we
2144
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2145
        is skipped entirely.
2146
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2147
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2148
                                                       new_plan)
2149
        last_j = 0
2150
        for i, j, n in matcher.get_matching_blocks():
2151
            for jj in range(last_j, j):
2152
                yield new_plan[jj]
2153
            for jj in range(j, j+n):
2154
                plan_line = new_plan[jj]
2155
                if plan_line[0] == 'new-b':
2156
                    pass
2157
                elif plan_line[0] == 'killed-b':
2158
                    yield 'unchanged', plan_line[1]
2159
                else:
2160
                    yield plan_line
2161
            last_j = j + n
2162
2163
2164
class _PlanMerge(_PlanMergeBase):
2165
    """Plan an annotate merge using on-the-fly annotation"""
2166
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2167
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2168
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2169
        self.a_key = self._key_prefix + (self.a_rev,)
2170
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2171
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2172
        heads = self.graph.heads((self.a_key, self.b_key))
2173
        if len(heads) == 1:
2174
            # one side dominates, so we can just return its values, yay for
2175
            # per-file graphs
2176
            # Ideally we would know that before we get this far
2177
            self._head_key = heads.pop()
2178
            if self._head_key == self.a_key:
2179
                other = b_rev
2180
            else:
2181
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2182
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2183
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2184
            self._weave = None
2185
        else:
2186
            self._head_key = None
2187
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2188
2189
    def _precache_tip_lines(self):
2190
        # Turn this into a no-op, because we will do this later
2191
        pass
2192
2193
    def _find_recursive_lcas(self):
2194
        """Find all the ancestors back to a unique lca"""
2195
        cur_ancestors = (self.a_key, self.b_key)
2196
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2197
        # rather than a key tuple. We will just map that directly to no common
2198
        # ancestors.
2199
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2200
        while True:
2201
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2202
            # Map a plain NULL_REVISION to a simple no-ancestors
6619.3.12 by Jelmer Vernooij
Use 2to3 set_literal fixer.
2203
            if next_lcas == {_mod_revision.NULL_REVISION}:
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2204
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2205
            # Order the lca's based on when they were merged into the tip
2206
            # While the actual merge portion of weave merge uses a set() of
2207
            # active revisions, the order of insertion *does* effect the
2208
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2209
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2210
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2211
                                                                    next_lcas))
2212
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2213
            if len(next_lcas) == 0:
2214
                break
2215
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2216
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2217
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2218
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2219
                # More than 2 lca's, fall back to grabbing all nodes between
2220
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2221
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2222
                             ' %s, %s\n=> %s',
2223
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2224
                cur_lcas = next_lcas
2225
                while len(cur_lcas) > 1:
2226
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2227
                if len(cur_lcas) == 0:
2228
                    # No common base to find, use the full ancestry
2229
                    unique_lca = None
2230
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2231
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2232
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2233
                        # find_lca will return a plain 'NULL_REVISION' rather
2234
                        # than a key tuple when there is no common ancestor, we
2235
                        # prefer to just use None, because it doesn't confuse
2236
                        # _get_interesting_texts()
2237
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2238
                parent_map.update(self._find_unique_parents(next_lcas,
2239
                                                            unique_lca))
2240
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2241
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2242
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2243
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2244
    def _find_unique_parents(self, tip_keys, base_key):
2245
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2246
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2247
        :param tip_keys: Nodes that are interesting
2248
        :param base_key: Cull all ancestors of this node
2249
        :return: The parent map for all revisions between tip_keys and
2250
            base_key. base_key will be included. References to nodes outside of
2251
            the ancestor set will also be removed.
2252
        """
2253
        # TODO: this would be simpler if find_unique_ancestors took a list
2254
        #       instead of a single tip, internally it supports it, but it
2255
        #       isn't a "backwards compatible" api change.
2256
        if base_key is None:
2257
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2258
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2259
            # thus confuses things like _get_interesting_texts, and our logic
2260
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2261
            if _mod_revision.NULL_REVISION in parent_map:
2262
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2263
        else:
2264
            interesting = set()
2265
            for tip in tip_keys:
2266
                interesting.update(
2267
                    self.graph.find_unique_ancestors(tip, [base_key]))
2268
            parent_map = self.graph.get_parent_map(interesting)
2269
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2270
        culled_parent_map, child_map, tails = self._remove_external_references(
2271
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2272
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2273
        if base_key is not None:
2274
            tails.remove(base_key)
2275
            self._prune_tails(culled_parent_map, child_map, tails)
2276
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2277
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2278
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2279
2280
    @staticmethod
2281
    def _remove_external_references(parent_map):
2282
        """Remove references that go outside of the parent map.
2283
2284
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2285
        :return: (filtered_parent_map, child_map, tails)
2286
            filtered_parent_map is parent_map without external references
2287
            child_map is the {parent_key: [child_keys]} mapping
2288
            tails is a list of nodes that do not have any parents in the map
2289
        """
2290
        # TODO: The basic effect of this function seems more generic than
2291
        #       _PlanMerge. But the specific details of building a child_map,
2292
        #       and computing tails seems very specific to _PlanMerge.
2293
        #       Still, should this be in Graph land?
2294
        filtered_parent_map = {}
2295
        child_map = {}
2296
        tails = []
6656.1.1 by Martin
Apply 2to3 dict fixer and clean up resulting mess using view helpers
2297
        for key, parent_keys in viewitems(parent_map):
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2298
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2299
            if not culled_parent_keys:
2300
                tails.append(key)
2301
            for parent_key in culled_parent_keys:
2302
                child_map.setdefault(parent_key, []).append(key)
2303
            # TODO: Do we want to do this, it adds overhead for every node,
2304
            #       just to say that the node has no children
2305
            child_map.setdefault(key, [])
2306
            filtered_parent_map[key] = culled_parent_keys
2307
        return filtered_parent_map, child_map, tails
2308
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2309
    @staticmethod
2310
    def _prune_tails(parent_map, child_map, tails_to_remove):
2311
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2312
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2313
        This will remove the supplied revisions until no more children have 0
2314
        parents.
2315
2316
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2317
            be modified in place.
2318
        :param tails_to_remove: A list of tips that should be removed,
2319
            this list will be consumed
2320
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2321
            this dict will be modified
2322
        :return: None, parent_map will be modified in place.
2323
        """
2324
        while tails_to_remove:
2325
            next = tails_to_remove.pop()
2326
            parent_map.pop(next)
2327
            children = child_map.pop(next)
2328
            for child in children:
2329
                child_parents = parent_map[child]
2330
                child_parents.remove(next)
2331
                if len(child_parents) == 0:
2332
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2333
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2334
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2335
        """Return a dict of texts we are interested in.
2336
2337
        Note that the input is in key tuples, but the output is in plain
2338
        revision ids.
2339
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2340
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2341
        :return: A dict of {'revision_id':lines} as returned by
2342
            _PlanMergeBase.get_lines()
2343
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2344
        all_revision_keys = set(parent_map)
2345
        all_revision_keys.add(self.a_key)
2346
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2347
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2348
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2349
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2350
        return all_texts
2351
2352
    def _build_weave(self):
6670.4.3 by Jelmer Vernooij
Fix more imports.
2353
        from .bzr import weave
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2354
        self._weave = weave.Weave(weave_name='in_memory_weave',
2355
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2356
        parent_map = self._find_recursive_lcas()
2357
2358
        all_texts = self._get_interesting_texts(parent_map)
2359
2360
        # Note: Unfortunately, the order given by topo_sort will effect the
2361
        # ordering resolution in the output. Specifically, if you add A then B,
2362
        # then in the output text A lines will show up before B lines. And, of
2363
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2364
        # So we use merge_sort, and add a fake node on the tip.
2365
        # This ensures that left-hand parents will always be inserted into the
2366
        # weave before right-hand parents.
2367
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2368
        parent_map[tip_key] = (self.a_key, self.b_key)
2369
2370
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2371
                                                                  tip_key)):
2372
            if key == tip_key:
2373
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2374
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2375
            parent_keys = parent_map[key]
2376
            revision_id = key[-1]
2377
            parent_ids = [k[-1] for k in parent_keys]
2378
            self._weave.add_lines(revision_id, parent_ids,
2379
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2380
2381
    def plan_merge(self):
2382
        """Generate a 'plan' for merging the two revisions.
2383
2384
        This involves comparing their texts and determining the cause of
2385
        differences.  If text A has a line and text B does not, then either the
2386
        line was added to text A, or it was deleted from B.  Once the causes
2387
        are combined, they are written out in the format described in
2388
        VersionedFile.plan_merge
2389
        """
2390
        if self._head_key is not None: # There was a single head
2391
            if self._head_key == self.a_key:
2392
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2393
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2394
                if self._head_key != self.b_key:
2395
                    raise AssertionError('There was an invalid head: %s != %s'
2396
                                         % (self.b_key, self._head_key))
2397
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2398
            head_rev = self._head_key[-1]
2399
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2400
            return ((plan, line) for line in lines)
2401
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2402
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2403
2404
class _PlanLCAMerge(_PlanMergeBase):
2405
    """
3144.3.7 by Aaron Bentley
Update from review
2406
    This merge algorithm differs from _PlanMerge in that:
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2407
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2408
    1. comparisons are done against LCAs only
2409
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2410
       another are marked as conflicts, by emitting the line as conflicted-a
2411
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2412
2413
    This is faster, and hopefully produces more useful output.
2414
    """
2415
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2416
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2417
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2418
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2419
        self.lcas = set()
2420
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2421
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2422
                self.lcas.add(lca)
2423
            else:
2424
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2425
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2426
            if _mod_revision.is_null(lca):
2427
                lca_lines = []
2428
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2429
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2430
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2431
                                                           lca_lines)
2432
            blocks = list(matcher.get_matching_blocks())
2433
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2434
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2435
                                                           lca_lines)
2436
            blocks = list(matcher.get_matching_blocks())
2437
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2438
3144.3.7 by Aaron Bentley
Update from review
2439
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2440
        """Determines the status unique lines versus all lcas.
2441
2442
        Basically, determines why the line is unique to this revision.
2443
2444
        A line may be determined new, killed, or both.
2445
3144.3.7 by Aaron Bentley
Update from review
2446
        If a line is determined new, that means it was not present in at least
2447
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2448
2449
        If a line is determined killed, that means the line was present in
2450
        at least one LCA.
2451
2452
        If a line is killed and new, this indicates that the two merge
2453
        revisions contain differing conflict resolutions.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2454
3144.3.7 by Aaron Bentley
Update from review
2455
        :param revision_id: The id of the revision in which the lines are
2456
            unique
2457
        :param unique_line_numbers: The line numbers of unique lines.
5891.1.2 by Andrew Bennetts
Fix a bunch of docstring formatting nits, making pydoctor a bit happier.
2458
        :return: a tuple of (new_this, killed_other)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2459
        """
2460
        new = set()
2461
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2462
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2463
        for lca in self.lcas:
2464
            blocks = self._get_matching_blocks(revision_id, lca)
2465
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2466
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2467
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2468
        return new, killed