/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
5752.3.8 by John Arbash Meinel
Merge bzr.dev 5764 to resolve release-notes (aka NEWS) conflicts
1
# Copyright (C) 2005-2011 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
4183.7.1 by Sabin Iacob
update FSF mailing address
15
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
1110 by Martin Pool
- merge aaron's merge improvements:
16
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
17
import warnings
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
18
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
19
from bzrlib.lazy_import import lazy_import
20
lazy_import(globals(), """
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
21
from bzrlib import (
4721.3.1 by Vincent Ladeuil
Cleanup imports.
22
    branch as _mod_branch,
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
23
    cleanup,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
24
    conflicts as _mod_conflicts,
1551.19.17 by Aaron Bentley
Add debugging flag for merges
25
    debug,
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
26
    generate_ids,
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
27
    graph as _mod_graph,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
28
    merge3,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
29
    osutils,
1551.15.46 by Aaron Bentley
Move plan merge to tree
30
    patiencediff,
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
31
    revision as _mod_revision,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
32
    textfile,
33
    trace,
34
    transform,
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
35
    tree as _mod_tree,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
36
    tsort,
4721.3.1 by Vincent Ladeuil
Cleanup imports.
37
    ui,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
38
    versionedfile,
5246.2.27 by Andrew Bennetts
Remove merge_into_helper for now, as it currently has no callers.
39
    workingtree,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
40
    )
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
41
""")
42
from bzrlib import (
43
    decorators,
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
44
    errors,
5246.2.15 by Andrew Bennetts
Lazy import most things in merge.py, to minimise the impact of plugins that need to import bzrlib.merge to install a hook.
45
    hooks,
46
    )
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
47
from bzrlib.symbol_versioning import (
48
    deprecated_in,
49
    deprecated_method,
50
    )
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
51
# TODO: Report back as changes are merged in
52
2325.3.1 by John Arbash Meinel
New helper function for merge, which allows us to re-use the existing workingtree, rather than opening it again.
53
1185.35.4 by Aaron Bentley
Implemented remerge
54
def transform_tree(from_tree, to_tree, interesting_ids=None):
4595.13.1 by Alexander Belchenko
[cherrypick revno.4635 from bzr.dev] (robertc) Fix many locking errors on windows due to a small bug in merge.transform_tree. (Robert Collins)
55
    from_tree.lock_tree_write()
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
56
    operation = cleanup.OperationWithCleanups(merge_inner)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
57
    operation.add_cleanup(from_tree.unlock)
58
    operation.run_simple(from_tree.branch, to_tree, from_tree,
59
        ignore_zero=True, interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
60
1457.1.12 by Robert Collins
Update comment to reflect author.
61
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
62
class MergeHooks(hooks.Hooks):
63
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
64
    def __init__(self):
65
        hooks.Hooks.__init__(self, "bzrlib.merge", "Merger.hooks")
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
66
        self.add_hook('merge_file_content',
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
67
            "Called with a bzrlib.merge.Merger object to create a per file "
68
            "merge object when starting a merge. "
69
            "Should return either None or a subclass of "
70
            "``bzrlib.merge.AbstractPerFileMerger``. "
71
            "Such objects will then be called per file "
72
            "that needs to be merged (including when one "
73
            "side has deleted the file and the other has changed it). "
74
            "See the AbstractPerFileMerger API docs for details on how it is "
75
            "used by merge.",
5622.3.2 by Jelmer Vernooij
Add more lazily usable hook points.
76
            (2, 1))
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
77
78
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
79
class AbstractPerFileMerger(object):
80
    """PerFileMerger objects are used by plugins extending merge for bzrlib.
81
82
    See ``bzrlib.plugins.news_merge.news_merge`` for an example concrete class.
83
    
84
    :ivar merger: The Merge3Merger performing the merge.
85
    """
86
87
    def __init__(self, merger):
88
        """Create a PerFileMerger for use with merger."""
89
        self.merger = merger
90
91
    def merge_contents(self, merge_params):
92
        """Attempt to merge the contents of a single file.
93
        
94
        :param merge_params: A bzrlib.merge.MergeHookParams
95
        :return : A tuple of (status, chunks), where status is one of
96
            'not_applicable', 'success', 'conflicted', or 'delete'.  If status
97
            is 'success' or 'conflicted', then chunks should be an iterable of
98
            strings for the new file contents.
99
        """
100
        return ('not applicable', None)
101
102
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
103
class PerFileMerger(AbstractPerFileMerger):
104
    """Merge individual files when self.file_matches returns True.
105
106
    This class is intended to be subclassed.  The file_matches and
107
    merge_matching methods should be overridden with concrete implementations.
108
    """
109
110
    def file_matches(self, params):
111
        """Return True if merge_matching should be called on this file.
112
113
        Only called with merges of plain files with no clear winner.
114
115
        Subclasses must override this.
116
        """
117
        raise NotImplementedError(self.file_matches)
118
119
    def get_filename(self, params, tree):
120
        """Lookup the filename (i.e. basename, not path), given a Tree (e.g.
121
        self.merger.this_tree) and a MergeHookParams.
122
        """
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
123
        return osutils.basename(tree.id2path(params.file_id))
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
124
125
    def get_filepath(self, params, tree):
126
        """Calculate the path to the file in a tree.
127
128
        :param params: A MergeHookParams describing the file to merge
129
        :param tree: a Tree, e.g. self.merger.this_tree.
130
        """
131
        return tree.id2path(params.file_id)
132
133
    def merge_contents(self, params):
134
        """Merge the contents of a single file."""
135
        # Check whether this custom merge logic should be used.
136
        if (
137
            # OTHER is a straight winner, rely on default merge.
138
            params.winner == 'other' or
139
            # THIS and OTHER aren't both files.
140
            not params.is_file_merge() or
141
            # The filename doesn't match *.xml
142
            not self.file_matches(params)):
143
            return 'not_applicable', None
5168.2.3 by Andrew Bennetts
Change implementation of get_filename as suggested by John.
144
        return self.merge_matching(params)
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
145
146
    def merge_matching(self, params):
147
        """Merge the contents of a single file that has matched the criteria
148
        in PerFileMerger.merge_contents (is a conflict, is a file,
149
        self.file_matches is True).
150
151
        Subclasses must override this.
152
        """
153
        raise NotImplementedError(self.merge_matching)
154
155
156
class ConfigurableFileMerger(PerFileMerger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
157
    """Merge individual files when configured via a .conf file.
158
159
    This is a base class for concrete custom file merging logic. Concrete
160
    classes should implement ``merge_text``.
161
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
162
    See ``bzrlib.plugins.news_merge.news_merge`` for an example concrete class.
163
    
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
164
    :ivar affected_files: The configured file paths to merge.
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
165
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
166
    :cvar name_prefix: The prefix to use when looking up configuration
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
167
        details. <name_prefix>_merge_files describes the files targeted by the
168
        hook for example.
169
        
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
170
    :cvar default_files: The default file paths to merge when no configuration
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
171
        is present.
172
    """
173
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
174
    name_prefix = None
175
    default_files = None
176
177
    def __init__(self, merger):
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
178
        super(ConfigurableFileMerger, self).__init__(merger)
179
        self.affected_files = None
4797.5.3 by Robert Collins
Tweak ConfigurableFileMerger to use class variables rather than requiring __init__ wrapping as future proofing for helper functions.
180
        self.default_files = self.__class__.default_files or []
181
        self.name_prefix = self.__class__.name_prefix
182
        if self.name_prefix is None:
183
            raise ValueError("name_prefix must be set.")
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
184
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
185
    def file_matches(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
186
        """Check whether the file should call the merge hook.
187
188
        <name_prefix>_merge_files configuration variable is a list of files
189
        that should use the hook.
190
        """
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
191
        affected_files = self.affected_files
192
        if affected_files is None:
4797.21.1 by Aaron Bentley
Fix merge when this_tree is not a WorkingTree.
193
            config = self.merger.this_branch.get_config()
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
194
            # Until bzr provides a better policy for caching the config, we
195
            # just add the part we're interested in to the params to avoid
196
            # reading the config files repeatedly (bazaar.conf, location.conf,
197
            # branch.conf).
198
            config_key = self.name_prefix + '_merge_files'
199
            affected_files = config.get_user_option_as_list(config_key)
200
            if affected_files is None:
201
                # If nothing was specified in the config, use the default.
202
                affected_files = self.default_files
203
            self.affected_files = affected_files
204
        if affected_files:
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
205
            filepath = self.get_filepath(params, self.merger.this_tree)
206
            if filepath in affected_files:
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
207
                return True
208
        return False
209
5168.2.2 by Andrew Bennetts
Create a PerFileMerger helper class that is midway between AbstractPerFileMerger and ConfigurableFileMerger. It allows the example merge plugin in the docs (the always conflict *.xml files) to be much, much simpler.
210
    def merge_matching(self, params):
4797.9.1 by Vincent Ladeuil
No test was exercising the faulty code path.
211
        return self.merge_text(params)
4797.5.2 by Robert Collins
Refactor NewsMerger into a reusable base class merge.ConfigurableFileMerger.
212
213
    def merge_text(self, params):
214
        """Merge the byte contents of a single file.
215
216
        This is called after checking that the merge should be performed in
217
        merge_contents, and it should behave as per
218
        ``bzrlib.merge.AbstractPerFileMerger.merge_contents``.
219
        """
220
        raise NotImplementedError(self.merge_text)
221
222
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
223
class MergeHookParams(object):
4869.3.11 by Andrew Bennetts
More docs.
224
    """Object holding parameters passed to merge_file_content hooks.
225
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
226
    There are some fields hooks can access:
4869.3.11 by Andrew Bennetts
More docs.
227
228
    :ivar file_id: the file ID of the file being merged
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
229
    :ivar trans_id: the transform ID for the merge of this file
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
230
    :ivar this_kind: kind of file_id in 'this' tree
231
    :ivar other_kind: kind of file_id in 'other' tree
4869.3.24 by Andrew Bennetts
Mention 'winner' attribute in MergeHookParams' docstring.
232
    :ivar winner: one of 'this', 'other', 'conflict'
4869.3.11 by Andrew Bennetts
More docs.
233
    """
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
234
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
235
    def __init__(self, merger, file_id, trans_id, this_kind, other_kind,
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
236
            winner):
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
237
        self._merger = merger
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
238
        self.file_id = file_id
239
        self.trans_id = trans_id
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
240
        self.this_kind = this_kind
241
        self.other_kind = other_kind
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
242
        self.winner = winner
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
243
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
244
    def is_file_merge(self):
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
245
        """True if this_kind and other_kind are both 'file'."""
246
        return self.this_kind == 'file' and self.other_kind == 'file'
4869.3.34 by Vincent Ladeuil
Finish the patch based on reviews.
247
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
248
    @decorators.cachedproperty
249
    def base_lines(self):
250
        """The lines of the 'base' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
251
        return self._merger.get_lines(self._merger.base_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
252
253
    @decorators.cachedproperty
254
    def this_lines(self):
255
        """The lines of the 'this' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
256
        return self._merger.get_lines(self._merger.this_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
257
258
    @decorators.cachedproperty
259
    def other_lines(self):
260
        """The lines of the 'other' version of the file."""
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
261
        return self._merger.get_lines(self._merger.other_tree, self.file_id)
4869.3.13 by Andrew Bennetts
Add simple cachedproperty decorator, and add {this,other,base}_lines cachedproperties to MergeHookParams.
262
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
263
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
264
class Merger(object):
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
265
5622.3.10 by Jelmer Vernooij
Don't require arguments to hooks.
266
    hooks = MergeHooks()
4869.3.1 by Andrew Bennetts
Basic per-file merge hook.
267
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
268
    def __init__(self, this_branch, other_tree=None, base_tree=None,
1551.21.8 by Aaron Bentley
Remove now-redundant DummyProgress from Merger.__init__
269
                 this_tree=None, pb=None, change_reporter=None,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
270
                 recurse='down', revision_graph=None):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
271
        object.__init__(self)
272
        self.this_branch = this_branch
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
273
        self.this_basis = _mod_revision.ensure_null(
274
            this_branch.last_revision())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
275
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
276
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
277
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
278
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
279
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
280
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
281
        self.base_tree = base_tree
282
        self.ignore_zero = False
283
        self.backup_files = False
284
        self.interesting_ids = None
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
285
        self.interesting_files = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
286
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
287
        self.reprocess = False
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
288
        if pb is not None:
289
            warnings.warn("pb parameter to Merger() is deprecated and ignored")
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
290
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
291
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
292
        self.change_reporter = change_reporter
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
293
        self._cached_trees = {}
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
294
        self._revision_graph = revision_graph
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
295
        self._base_is_ancestor = None
296
        self._base_is_other_ancestor = None
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
297
        self._is_criss_cross = None
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
298
        self._lca_trees = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
299
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
300
    def cache_trees_with_revision_ids(self, trees):
301
        """Cache any tree in trees if it has a revision_id."""
302
        for maybe_tree in trees:
303
            if maybe_tree is None:
304
                continue
305
            try:
306
                rev_id = maybe_tree.get_revision_id()
307
            except AttributeError:
308
                continue
309
            self._cached_trees[rev_id] = maybe_tree
310
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
311
    @property
312
    def revision_graph(self):
313
        if self._revision_graph is None:
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
314
            self._revision_graph = self.this_branch.repository.get_graph()
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
315
        return self._revision_graph
316
317
    def _set_base_is_ancestor(self, value):
318
        self._base_is_ancestor = value
319
320
    def _get_base_is_ancestor(self):
321
        if self._base_is_ancestor is None:
322
            self._base_is_ancestor = self.revision_graph.is_ancestor(
323
                self.base_rev_id, self.this_basis)
324
        return self._base_is_ancestor
325
326
    base_is_ancestor = property(_get_base_is_ancestor, _set_base_is_ancestor)
327
328
    def _set_base_is_other_ancestor(self, value):
329
        self._base_is_other_ancestor = value
330
331
    def _get_base_is_other_ancestor(self):
332
        if self._base_is_other_ancestor is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
333
            if self.other_basis is None:
334
                return True
335
            self._base_is_other_ancestor = self.revision_graph.is_ancestor(
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
336
                self.base_rev_id, self.other_basis)
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
337
        return self._base_is_other_ancestor
338
339
    base_is_other_ancestor = property(_get_base_is_other_ancestor,
340
                                      _set_base_is_other_ancestor)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
341
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
342
    @staticmethod
1551.21.7 by Aaron Bentley
Fix progress warning
343
    def from_uncommitted(tree, other_tree, pb=None, base_tree=None):
1551.15.74 by Aaron Bentley
Textual updates from review
344
        """Return a Merger for uncommitted changes in other_tree.
345
346
        :param tree: The tree to merge into
347
        :param other_tree: The tree to get uncommitted changes from
348
        :param pb: A progress indicator
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
349
        :param base_tree: The basis to use for the merge.  If unspecified,
350
            other_tree.basis_tree() will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
351
        """
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
352
        if base_tree is None:
353
            base_tree = other_tree.basis_tree()
354
        merger = Merger(tree.branch, other_tree, base_tree, tree, pb)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
355
        merger.base_rev_id = merger.base_tree.get_revision_id()
356
        merger.other_rev_id = None
3146.5.1 by Aaron Bentley
Make merge --uncommitted work with merge-type weave
357
        merger.other_basis = merger.base_rev_id
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
358
        return merger
359
360
    @classmethod
361
    def from_mergeable(klass, tree, mergeable, pb):
1551.15.74 by Aaron Bentley
Textual updates from review
362
        """Return a Merger for a bundle or merge directive.
363
364
        :param tree: The tree to merge changes into
365
        :param mergeable: A merge directive or bundle
366
        :param pb: A progress indicator
367
        """
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
368
        mergeable.install_revisions(tree.branch.repository)
369
        base_revision_id, other_revision_id, verified =\
370
            mergeable.get_merge_request(tree.branch.repository)
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
371
        revision_graph = tree.branch.repository.get_graph()
1551.19.44 by Aaron Bentley
Fix handling of old merge directives with stricter get_parent_map
372
        if base_revision_id is not None:
373
            if (base_revision_id != _mod_revision.NULL_REVISION and
374
                revision_graph.is_ancestor(
375
                base_revision_id, tree.branch.last_revision())):
376
                base_revision_id = None
377
            else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
378
                trace.warning('Performing cherrypick')
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
379
        merger = klass.from_revision_ids(pb, tree, other_revision_id,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
380
                                         base_revision_id, revision_graph=
381
                                         revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
382
        return merger, verified
383
384
    @staticmethod
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
385
    def from_revision_ids(pb, tree, other, base=None, other_branch=None,
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
386
                          base_branch=None, revision_graph=None,
387
                          tree_branch=None):
1551.15.74 by Aaron Bentley
Textual updates from review
388
        """Return a Merger for revision-ids.
389
3363.17.15 by Aaron Bentley
Update docs
390
        :param pb: A progress indicator
1551.15.74 by Aaron Bentley
Textual updates from review
391
        :param tree: The tree to merge changes into
392
        :param other: The revision-id to use as OTHER
393
        :param base: The revision-id to use as BASE.  If not specified, will
394
            be auto-selected.
395
        :param other_branch: A branch containing the other revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
396
            not supplied, tree.branch is used.
1551.15.74 by Aaron Bentley
Textual updates from review
397
        :param base_branch: A branch containing the base revision-id.  If
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
398
            not supplied, other_branch or tree.branch will be used.
399
        :param revision_graph: If you have a revision_graph precomputed, pass
400
            it in, otherwise it will be created for you.
3363.17.15 by Aaron Bentley
Update docs
401
        :param tree_branch: The branch associated with tree.  If not supplied,
402
            tree.branch will be used.
1551.15.74 by Aaron Bentley
Textual updates from review
403
        """
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
404
        if tree_branch is None:
405
            tree_branch = tree.branch
406
        merger = Merger(tree_branch, this_tree=tree, pb=pb,
3146.5.3 by Aaron Bentley
Avoid retrieving revision graph twice
407
                        revision_graph=revision_graph)
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
408
        if other_branch is None:
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
409
            other_branch = tree.branch
1551.15.67 by Aaron Bentley
Stop using _merge_helper for merging
410
        merger.set_other_revision(other, other_branch)
411
        if base is None:
412
            merger.find_base()
413
        else:
414
            if base_branch is None:
415
                base_branch = other_branch
416
            merger.set_base_revision(base, base_branch)
417
        return merger
418
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
419
    def revision_tree(self, revision_id, branch=None):
420
        if revision_id not in self._cached_trees:
421
            if branch is None:
422
                branch = self.this_branch
423
            try:
424
                tree = self.this_tree.revision_tree(revision_id)
425
            except errors.NoSuchRevisionInTree:
426
                tree = branch.repository.revision_tree(revision_id)
427
            self._cached_trees[revision_id] = tree
428
        return self._cached_trees[revision_id]
429
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
430
    def _get_tree(self, treespec, possible_transports=None):
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
431
        location, revno = treespec
432
        if revno is None:
433
            tree = workingtree.WorkingTree.open_containing(location)[0]
434
            return tree.branch, tree
4721.3.1 by Vincent Ladeuil
Cleanup imports.
435
        branch = _mod_branch.Branch.open_containing(
436
            location, possible_transports)[0]
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
437
        if revno == -1:
438
            revision_id = branch.last_revision()
439
        else:
440
            revision_id = branch.get_rev_id(revno)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
441
        revision_id = _mod_revision.ensure_null(revision_id)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
442
        return branch, self.revision_tree(revision_id, branch)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
443
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
444
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
445
    def ensure_revision_trees(self):
446
        if self.this_revision_tree is None:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
447
            self.this_basis_tree = self.revision_tree(self.this_basis)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
448
            if self.this_basis == self.this_rev_id:
449
                self.this_revision_tree = self.this_basis_tree
450
1185.12.83 by Aaron Bentley
Preliminary weave merge support
451
        if self.other_rev_id is None:
452
            other_basis_tree = self.revision_tree(self.other_basis)
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
453
            if other_basis_tree.has_changes(self.other_tree):
4869.2.1 by Andrew Bennetts
Trivial improvements to bzrlib/merge.py suggested by pyflakes.
454
                raise errors.WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
455
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
456
            self.other_tree = other_basis_tree
457
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
458
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.83 by Aaron Bentley
Preliminary weave merge support
459
    def file_revisions(self, file_id):
460
        self.ensure_revision_trees()
461
        def get_id(tree, file_id):
462
            revision_id = tree.inventory[file_id].revision
463
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
464
        if self.this_rev_id is None:
465
            if self.this_basis_tree.get_file_sha1(file_id) != \
466
                self.this_tree.get_file_sha1(file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
467
                raise errors.WorkingTreeNotRevision(self.this_tree)
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
468
469
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
470
        return [get_id(tree, file_id) for tree in trees]
471
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
472
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
473
    def check_basis(self, check_clean, require_commits=True):
474
        if self.this_basis is None and require_commits is True:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
475
            raise errors.BzrCommandError(
476
                "This branch has no commits."
477
                " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
478
        if check_clean:
479
            self.compare_basis()
480
            if self.this_basis != self.this_rev_id:
2796.2.1 by Aaron Bentley
Begin work on reconfigure command
481
                raise errors.UncommittedChanges(self.this_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
482
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
483
    @deprecated_method(deprecated_in((2, 1, 0)))
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
484
    def compare_basis(self):
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
485
        try:
486
            basis_tree = self.revision_tree(self.this_tree.last_revision())
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
487
        except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
488
            basis_tree = self.this_tree.basis_tree()
4503.1.2 by Vincent Ladeuil
Use tree.has_changes() where appropriate (the test suite caught a
489
        if not self.this_tree.has_changes(basis_tree):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
490
            self.this_rev_id = self.this_basis
491
492
    def set_interesting_files(self, file_list):
2590.2.7 by Aaron Bentley
Misc cleanup
493
        self.interesting_files = file_list
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
494
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
495
    def set_pending(self):
4721.3.2 by Vincent Ladeuil
Simplify mutable_tree.has_changes() and update call sites.
496
        if (not self.base_is_ancestor or not self.base_is_other_ancestor
497
            or self.other_rev_id is None):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
498
            return
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
499
        self._add_parent()
500
501
    def _add_parent(self):
502
        new_parents = self.this_tree.get_parent_ids() + [self.other_rev_id]
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
503
        new_parent_trees = []
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
504
        operation = cleanup.OperationWithCleanups(
505
            self.this_tree.set_parent_trees)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
506
        for revision_id in new_parents:
507
            try:
508
                tree = self.revision_tree(revision_id)
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
509
            except errors.NoSuchRevision:
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
510
                tree = None
511
            else:
512
                tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
513
                operation.add_cleanup(tree.unlock)
2590.2.20 by Aaron Bentley
Fix handling of ghost base trees
514
            new_parent_trees.append((revision_id, tree))
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
515
        operation.run_simple(new_parent_trees, allow_leftmost_as_ghost=True)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
516
2485.8.37 by Vincent Ladeuil
Fix merge multiple connections. Test suite *not* passing (sftp
517
    def set_other(self, other_revision, possible_transports=None):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
518
        """Set the revision and tree to merge from.
519
520
        This sets the other_tree, other_rev_id, other_basis attributes.
521
522
        :param other_revision: The [path, revision] list to merge from.
523
        """
2485.8.58 by Vincent Ladeuil
merge bzr.dev@1617
524
        self.other_branch, self.other_tree = self._get_tree(other_revision,
525
                                                            possible_transports)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
526
        if other_revision[1] == -1:
2598.5.4 by Aaron Bentley
Restore original Branch.last_revision behavior, fix bits that care
527
            self.other_rev_id = _mod_revision.ensure_null(
528
                self.other_branch.last_revision())
2598.5.1 by Aaron Bentley
Start eliminating the use of None to indicate null revision
529
            if _mod_revision.is_null(self.other_rev_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
530
                raise errors.NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
531
            self.other_basis = self.other_rev_id
532
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
533
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
534
            self.other_basis = self.other_rev_id
535
        else:
536
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
537
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
538
            if self.other_basis is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
539
                raise errors.NoCommits(self.other_branch)
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
540
        if self.other_rev_id is not None:
541
            self._cached_trees[self.other_rev_id] = self.other_tree
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
542
        self._maybe_fetch(self.other_branch,self.this_branch, self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
543
2100.3.29 by Aaron Bentley
Get merge working initially
544
    def set_other_revision(self, revision_id, other_branch):
545
        """Set 'other' based on a branch and revision id
546
547
        :param revision_id: The revision to use for a tree
548
        :param other_branch: The branch containing this tree
549
        """
550
        self.other_rev_id = revision_id
551
        self.other_branch = other_branch
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
552
        self._maybe_fetch(other_branch, self.this_branch, self.other_rev_id)
2100.3.29 by Aaron Bentley
Get merge working initially
553
        self.other_tree = self.revision_tree(revision_id)
554
        self.other_basis = revision_id
555
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
556
    def set_base_revision(self, revision_id, branch):
557
        """Set 'base' based on a branch and revision id
558
559
        :param revision_id: The revision to use for a tree
560
        :param branch: The branch containing this tree
561
        """
562
        self.base_rev_id = revision_id
563
        self.base_branch = branch
2520.4.132 by Aaron Bentley
Merge from bzr.dev
564
        self._maybe_fetch(branch, self.this_branch, revision_id)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
565
        self.base_tree = self.revision_tree(revision_id)
2520.4.132 by Aaron Bentley
Merge from bzr.dev
566
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
567
    def _maybe_fetch(self, source, target, revision_id):
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
568
        if not source.repository.has_same_location(target.repository):
5535.3.30 by Andrew Bennetts
Fetch tags during merge too.
569
            try:
5535.3.31 by Andrew Bennetts
Cope with tags that reference missing revisions.
570
                tags_to_fetch = set(source.tags.get_reverse_tag_dict())
5535.3.30 by Andrew Bennetts
Fetch tags during merge too.
571
            except errors.TagsNotSupported:
5535.3.31 by Andrew Bennetts
Cope with tags that reference missing revisions.
572
                tags_to_fetch = None
5535.3.30 by Andrew Bennetts
Fetch tags during merge too.
573
            fetch_spec = _mod_graph.NotInOtherForRevs(target.repository,
5535.3.47 by Andrew Bennetts
Merge fetch-all-tags-309682.
574
                source.repository, [revision_id],
575
                if_present_ids=tags_to_fetch).execute()
5535.3.30 by Andrew Bennetts
Fetch tags during merge too.
576
            target.fetch(source, fetch_spec=fetch_spec)
2520.4.110 by Aaron Bentley
Implement cherrypick support for merge directives
577
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
578
    def find_base(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
579
        revisions = [_mod_revision.ensure_null(self.this_basis),
580
                     _mod_revision.ensure_null(self.other_basis)]
581
        if _mod_revision.NULL_REVISION in revisions:
582
            self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.36 by John Arbash Meinel
Optimizing how we extracted multiple trees left a path that didn't create a base_tree.
583
            self.base_tree = self.revision_tree(self.base_rev_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
584
            self._is_criss_cross = False
2590.2.22 by Aaron Bentley
Remove cruft
585
        else:
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
586
            lcas = self.revision_graph.find_lca(revisions[0], revisions[1])
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
587
            self._is_criss_cross = False
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
588
            if len(lcas) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
589
                self.base_rev_id = _mod_revision.NULL_REVISION
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
590
            elif len(lcas) == 1:
591
                self.base_rev_id = list(lcas)[0]
592
            else: # len(lcas) > 1
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
593
                self._is_criss_cross = True
3514.4.23 by John Arbash Meinel
Handle when there are more than 2 LCAs while searching for the unique lca.
594
                if len(lcas) > 2:
595
                    # find_unique_lca can only handle 2 nodes, so we have to
596
                    # start back at the beginning. It is a shame to traverse
597
                    # the graph again, but better than re-implementing
598
                    # find_unique_lca.
599
                    self.base_rev_id = self.revision_graph.find_unique_lca(
600
                                            revisions[0], revisions[1])
601
                else:
602
                    self.base_rev_id = self.revision_graph.find_unique_lca(
603
                                            *lcas)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
604
                sorted_lca_keys = self.revision_graph.find_merge_order(                
605
                    revisions[0], lcas)
606
                if self.base_rev_id == _mod_revision.NULL_REVISION:
607
                    self.base_rev_id = sorted_lca_keys[0]
608
                
4721.3.1 by Vincent Ladeuil
Cleanup imports.
609
            if self.base_rev_id == _mod_revision.NULL_REVISION:
610
                raise errors.UnrelatedBranches()
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
611
            if self._is_criss_cross:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
612
                trace.warning('Warning: criss-cross merge encountered.  See bzr'
613
                              ' help criss-cross.')
614
                trace.mutter('Criss-cross lcas: %r' % lcas)
5540.1.7 by Gary van der Merwe
Add mutter for when we cant find a unique lca, and what revision we used as a base_rev_id.
615
                if self.base_rev_id in lcas:
616
                    trace.mutter('Unable to find unique lca. '
617
                                 'Fallback %r as best option.' % self.base_rev_id)
5540.1.6 by Gary van der Merwe
We just need a set for this.
618
                interesting_revision_ids = set(lcas)
619
                interesting_revision_ids.add(self.base_rev_id)
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
620
                interesting_trees = dict((t.get_revision_id(), t)
621
                    for t in self.this_branch.repository.revision_trees(
622
                        interesting_revision_ids))
623
                self._cached_trees.update(interesting_trees)
5540.1.3 by Gary van der Merwe
Make merge correctly locate a lca where there is a criss-cross merge of a new root.
624
                if self.base_rev_id in lcas:
625
                    self.base_tree = interesting_trees[self.base_rev_id]
626
                else:
627
                    self.base_tree = interesting_trees.pop(self.base_rev_id)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
628
                self._lca_trees = [interesting_trees[key]
629
                                   for key in sorted_lca_keys]
3514.4.2 by John Arbash Meinel
Extract the lca trees and the base tree when we find a criss-cross
630
            else:
631
                self.base_tree = self.revision_tree(self.base_rev_id)
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
632
        self.base_is_ancestor = True
2590.2.18 by Aaron Bentley
Merge is_ancestor fix
633
        self.base_is_other_ancestor = True
4721.3.1 by Vincent Ladeuil
Cleanup imports.
634
        trace.mutter('Base revid: %r' % self.base_rev_id)
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
635
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
636
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
637
        """Set the base revision to use for the merge.
638
639
        :param base_revision: A 2-list containing a path and revision number.
640
        """
4721.3.1 by Vincent Ladeuil
Cleanup imports.
641
        trace.mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
642
        if base_revision == [None, None]:
2590.2.13 by Aaron Bentley
Make find_base implement the base_finding code
643
            self.find_base()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
644
        else:
2590.2.11 by Aaron Bentley
Aggressively cache trees, use dirstate. re-mplement _add_parent.
645
            base_branch, self.base_tree = self._get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
646
            if base_revision[1] == -1:
647
                self.base_rev_id = base_branch.last_revision()
648
            elif base_revision[1] is None:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
649
                self.base_rev_id = _mod_revision.NULL_REVISION
493 by Martin Pool
- Merge aaron's merge command
650
            else:
2598.5.3 by Aaron Bentley
Push NULL_REVISION deeper
651
                self.base_rev_id = _mod_revision.ensure_null(
652
                    base_branch.get_rev_id(base_revision[1]))
2590.2.19 by Aaron Bentley
Avoid fetch within a repository
653
            self._maybe_fetch(base_branch, self.this_branch, self.base_rev_id)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
654
3008.1.8 by Michael Hudson
extract merger creation into a method
655
    def make_merger(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
656
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
657
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
658
                  'interesting_ids': self.interesting_ids,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
659
                  'interesting_files': self.interesting_files,
4961.2.20 by Martin Pool
Resolve conflicts with trunk
660
                  'this_branch': self.this_branch,
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
661
                  'do_merge': False}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
662
        if self.merge_type.requires_base:
663
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
664
        if self.merge_type.supports_reprocess:
665
            kwargs['reprocess'] = self.reprocess
666
        elif self.reprocess:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
667
            raise errors.BzrError(
668
                "Conflict reduction is not supported for merge"
669
                " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
670
        if self.merge_type.supports_show_base:
671
            kwargs['show_base'] = self.show_base
672
        elif self.show_base:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
673
            raise errors.BzrError("Showing base is not supported for this"
674
                                  " merge type. %s" % self.merge_type)
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
675
        if (not getattr(self.merge_type, 'supports_reverse_cherrypick', True)
676
            and not self.base_is_other_ancestor):
677
            raise errors.CannotReverseCherrypick()
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
678
        if self.merge_type.supports_cherrypick:
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
679
            kwargs['cherrypick'] = (not self.base_is_ancestor or
680
                                    not self.base_is_other_ancestor)
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
681
        if self._is_criss_cross and getattr(self.merge_type,
682
                                            'supports_lca_trees', False):
683
            kwargs['lca_trees'] = self._lca_trees
4961.2.11 by Martin Pool
Pull out pbs and ProgressPhases stored in object state; just use them in single functions
684
        return self.merge_type(pb=None,
3008.1.8 by Michael Hudson
extract merger creation into a method
685
                               change_reporter=self.change_reporter,
686
                               **kwargs)
687
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
688
    def _do_merge_to(self):
689
        merge = self.make_merger()
4273.1.9 by Aaron Bentley
Cleanup
690
        if self.other_branch is not None:
691
            self.other_branch.update_references(self.this_branch)
3619.6.4 by Mark Hammond
do_merge gets one 'finally' per lock so locks always released on failure.
692
        merge.do_merge()
693
        if self.recurse == 'down':
694
            for relpath, file_id in self.this_tree.iter_references():
695
                sub_tree = self.this_tree.get_nested_tree(file_id, relpath)
696
                other_revision = self.other_tree.get_reference_revision(
697
                    file_id, relpath)
698
                if  other_revision == sub_tree.last_revision():
699
                    continue
700
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
701
                sub_merge.merge_type = self.merge_type
702
                other_branch = self.other_branch.reference_parent(file_id, relpath)
703
                sub_merge.set_other_revision(other_revision, other_branch)
704
                base_revision = self.base_tree.get_reference_revision(file_id)
705
                sub_merge.base_tree = \
706
                    sub_tree.branch.repository.revision_tree(base_revision)
707
                sub_merge.base_rev_id = base_revision
708
                sub_merge.do_merge()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
709
        return merge
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
710
3008.1.8 by Michael Hudson
extract merger creation into a method
711
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
712
        operation = cleanup.OperationWithCleanups(self._do_merge_to)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
713
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
714
        operation.add_cleanup(self.this_tree.unlock)
715
        if self.base_tree is not None:
716
            self.base_tree.lock_read()
717
            operation.add_cleanup(self.base_tree.unlock)
718
        if self.other_tree is not None:
719
            self.other_tree.lock_read()
720
            operation.add_cleanup(self.other_tree.unlock)
721
        merge = operation.run_simple()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
722
        if len(merge.cooked_conflicts) == 0:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
723
            if not self.ignore_zero and not trace.is_quiet():
724
                trace.note("All changes applied successfully.")
1534.7.141 by Aaron Bentley
Added conflict reporting
725
        else:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
726
            trace.note("%d conflicts encountered."
727
                       % len(merge.cooked_conflicts))
1534.7.141 by Aaron Bentley
Added conflict reporting
728
1534.7.134 by Aaron Bentley
Hid raw conflicts
729
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
730
1545.2.4 by Aaron Bentley
PEP8 fixes
731
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
732
class _InventoryNoneEntry(object):
733
    """This represents an inventory entry which *isn't there*.
734
735
    It simplifies the merging logic if we always have an InventoryEntry, even
736
    if it isn't actually present
737
    """
738
    executable = None
739
    kind = None
740
    name = None
741
    parent_id = None
742
    revision = None
743
    symlink_target = None
744
    text_sha1 = None
745
746
_none_entry = _InventoryNoneEntry()
747
748
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
749
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
750
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
751
    requires_base = True
752
    supports_reprocess = True
753
    supports_show_base = True
754
    history_based = False
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
755
    supports_cherrypick = True
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
756
    supports_reverse_cherrypick = True
2590.2.7 by Aaron Bentley
Misc cleanup
757
    winner_idx = {"this": 2, "other": 1, "conflict": 1}
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
758
    supports_lca_trees = True
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
759
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
760
    def __init__(self, working_tree, this_tree, base_tree, other_tree,
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
761
                 interesting_ids=None, reprocess=False, show_base=False,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
762
                 pb=None, pp=None, change_reporter=None,
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
763
                 interesting_files=None, do_merge=True,
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
764
                 cherrypick=False, lca_trees=None, this_branch=None):
2590.2.10 by Aaron Bentley
Updates from review
765
        """Initialize the merger object and perform the merge.
766
767
        :param working_tree: The working tree to apply the merge to
768
        :param this_tree: The local tree in the merge operation
769
        :param base_tree: The common tree in the merge operation
4031.3.1 by Frank Aspell
Fixing various typos
770
        :param other_tree: The other tree to merge changes from
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
771
        :param this_branch: The branch associated with this_tree.  Defaults to
772
            this_tree.branch if not supplied.
2590.2.10 by Aaron Bentley
Updates from review
773
        :param interesting_ids: The file_ids of files that should be
774
            participate in the merge.  May not be combined with
775
            interesting_files.
776
        :param: reprocess If True, perform conflict-reduction processing.
777
        :param show_base: If True, show the base revision in text conflicts.
778
            (incompatible with reprocess)
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
779
        :param pb: ignored
2590.2.10 by Aaron Bentley
Updates from review
780
        :param pp: A ProgressPhase object
781
        :param change_reporter: An object that should report changes made
782
        :param interesting_files: The tree-relative paths of files that should
783
            participate in the merge.  If these paths refer to directories,
784
            the contents of those directories will also be included.  May not
785
            be combined with interesting_ids.  If neither interesting_files nor
786
            interesting_ids is specified, all files may participate in the
787
            merge.
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
788
        :param lca_trees: Can be set to a dictionary of {revision_id:rev_tree}
789
            if the ancestry was found to include a criss-cross merge.
790
            Otherwise should be None.
2590.2.10 by Aaron Bentley
Updates from review
791
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
792
        object.__init__(self)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
793
        if interesting_files is not None and interesting_ids is not None:
794
            raise ValueError(
795
                'specify either interesting_ids or interesting_files')
5162.3.1 by Aaron Bentley
Fix switch/merge when a ConfigurableFileMerger is used.
796
        if this_branch is None:
797
            this_branch = this_tree.branch
2590.2.4 by Aaron Bentley
Move entry generation to a helper
798
        self.interesting_ids = interesting_ids
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
799
        self.interesting_files = interesting_files
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
800
        self.this_tree = working_tree
801
        self.base_tree = base_tree
802
        self.other_tree = other_tree
4869.3.27 by Andrew Bennetts
Move news_merge plugin from contrib to bzrlib/plugins, change it to be enabled via a 'news_merge_files' config option, move more code out of the __init__ to minimise overhead, and add lots of docstrings, add NEWS entry.
803
        self.this_branch = this_branch
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
804
        self._raw_conflicts = []
805
        self.cooked_conflicts = []
806
        self.reprocess = reprocess
807
        self.show_base = show_base
3514.4.4 by John Arbash Meinel
Test that the lca_trees are passed down to the Merger object when appropriate.
808
        self._lca_trees = lca_trees
3514.4.37 by John Arbash Meinel
Tests pass when using _entries_lca as the default algorithm.
809
        # Uncommenting this will change the default algorithm to always use
810
        # _entries_lca. This can be useful for running the test suite and
811
        # making sure we haven't missed any corner cases.
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
812
        # if lca_trees is None:
813
        #     self._lca_trees = [self.base_tree]
1551.11.9 by Aaron Bentley
Apply change reporting to merge
814
        self.change_reporter = change_reporter
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
815
        self.cherrypick = cherrypick
3008.1.11 by Michael Hudson
restore the default behaviour of Merge3Merger.__init__().
816
        if do_merge:
817
            self.do_merge()
4961.2.12 by Martin Pool
Further pb/pp removals
818
        if pp is not None:
819
            warnings.warn("pp argument to Merge3Merger is deprecated")
820
        if pb is not None:
821
            warnings.warn("pb argument to Merge3Merger is deprecated")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
822
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
823
    def do_merge(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
824
        operation = cleanup.OperationWithCleanups(self._do_merge)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
825
        self.this_tree.lock_tree_write()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
826
        operation.add_cleanup(self.this_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
827
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
828
        operation.add_cleanup(self.base_tree.unlock)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
829
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
830
        operation.add_cleanup(self.other_tree.unlock)
831
        operation.run()
832
833
    def _do_merge(self, operation):
5031.1.2 by Andrew Bennetts
Merge lp:bzr/2.1
834
        self.tt = transform.TreeTransform(self.this_tree, None)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
835
        operation.add_cleanup(self.tt.finalize)
836
        self._compute_transform()
837
        results = self.tt.apply(no_conflicts=True)
838
        self.write_modified(results)
5031.1.3 by Andrew Bennetts
Fix syntax error from bad conflict resolution.
839
        try:
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
840
            self.this_tree.add_conflicts(self.cooked_conflicts)
841
        except errors.UnsupportedOperation:
842
            pass
1534.7.192 by Aaron Bentley
Record hashes produced by merges
843
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
844
    def make_preview_transform(self):
5753.2.2 by Jelmer Vernooij
Remove some unnecessary imports, clean up lazy imports.
845
        operation = cleanup.OperationWithCleanups(self._make_preview_transform)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
846
        self.base_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
847
        operation.add_cleanup(self.base_tree.unlock)
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
848
        self.other_tree.lock_read()
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
849
        operation.add_cleanup(self.other_tree.unlock)
850
        return operation.run_simple()
851
852
    def _make_preview_transform(self):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
853
        self.tt = transform.TransformPreview(self.this_tree)
4797.16.1 by Andrew Bennetts
Replace many try/finally blocks in merge.py with more robust OperationWithCleanups.
854
        self._compute_transform()
3008.1.9 by Michael Hudson
wanton hacking that lets me write an efficient version of get_diff_as_merged
855
        return self.tt
856
3008.1.21 by Aaron Bentley
Make compute_transform private, test make_preview_transform
857
    def _compute_transform(self):
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
858
        if self._lca_trees is None:
859
            entries = self._entries3()
860
            resolver = self._three_way
861
        else:
862
            entries = self._entries_lca()
863
            resolver = self._lca_multi_way
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
864
        child_pb = ui.ui_factory.nested_progress_bar()
865
        try:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
866
            factories = Merger.hooks['merge_file_content']
867
            hooks = [factory(self) for factory in factories] + [self]
868
            self.active_hooks = [hook for hook in hooks if hook is not None]
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
869
            for num, (file_id, changed, parents3, names3,
870
                      executable3) in enumerate(entries):
871
                child_pb.update('Preparing file merge', num, len(entries))
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
872
                self._merge_names(file_id, parents3, names3, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
873
                if changed:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
874
                    file_status = self._do_merge_contents(file_id)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
875
                else:
876
                    file_status = 'unmodified'
877
                self._merge_executable(file_id,
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
878
                    executable3, file_status, resolver=resolver)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
879
        finally:
880
            child_pb.finished()
881
        self.fix_root()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
882
        self._finish_computing_transform()
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
883
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
884
    def _finish_computing_transform(self):
5246.2.4 by Andrew Bennetts
Remove a little bit of duplication.
885
        """Finalize the transform and report the changes.
886
887
        This is the second half of _compute_transform.
888
        """
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
889
        child_pb = ui.ui_factory.nested_progress_bar()
890
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
891
            fs_conflicts = transform.resolve_conflicts(self.tt, child_pb,
892
                lambda t, c: transform.conflict_pass(t, c, self.other_tree))
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
893
        finally:
894
            child_pb.finished()
895
        if self.change_reporter is not None:
896
            from bzrlib import delta
897
            delta.report_changes(
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
898
                self.tt.iter_changes(), self.change_reporter)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
899
        self.cook_conflicts(fs_conflicts)
900
        for conflict in self.cooked_conflicts:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
901
            trace.warning(conflict)
3008.1.6 by Michael Hudson
chop up Merge3Merger.__init__ into pieces
902
2590.2.4 by Aaron Bentley
Move entry generation to a helper
903
    def _entries3(self):
2590.2.7 by Aaron Bentley
Misc cleanup
904
        """Gather data about files modified between three trees.
905
906
        Return a list of tuples of file_id, changed, parents3, names3,
907
        executable3.  changed is a boolean indicating whether the file contents
908
        or kind were changed.  parents3 is a tuple of parent ids for base,
909
        other and this.  names3 is a tuple of names for base, other and this.
910
        executable3 is a tuple of execute-bit values for base, other and this.
911
        """
2590.2.4 by Aaron Bentley
Move entry generation to a helper
912
        result = []
3254.1.1 by Aaron Bentley
Make Tree.iter_changes a public method
913
        iterator = self.other_tree.iter_changes(self.base_tree,
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
914
                include_unchanged=True, specific_files=self.interesting_files,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
915
                extra_trees=[self.this_tree])
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
916
        this_entries = dict((e.file_id, e) for p, e in
917
                            self.this_tree.iter_entries_by_dir(
918
                            self.interesting_ids))
2590.2.4 by Aaron Bentley
Move entry generation to a helper
919
        for (file_id, paths, changed, versioned, parents, names, kind,
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
920
             executable) in iterator:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
921
            if (self.interesting_ids is not None and
922
                file_id not in self.interesting_ids):
923
                continue
3363.17.1 by Aaron Bentley
Avoid inventory for merge and transform code
924
            entry = this_entries.get(file_id)
925
            if entry is not None:
2590.2.4 by Aaron Bentley
Move entry generation to a helper
926
                this_name = entry.name
927
                this_parent = entry.parent_id
928
                this_executable = entry.executable
929
            else:
930
                this_name = None
931
                this_parent = None
932
                this_executable = None
933
            parents3 = parents + (this_parent,)
934
            names3 = names + (this_name,)
935
            executable3 = executable + (this_executable,)
936
            result.append((file_id, changed, parents3, names3, executable3))
937
        return result
938
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
939
    def _entries_lca(self):
940
        """Gather data about files modified between multiple trees.
941
942
        This compares OTHER versus all LCA trees, and for interesting entries,
943
        it then compares with THIS and BASE.
944
945
        For the multi-valued entries, the format will be (BASE, [lca1, lca2])
946
        :return: [(file_id, changed, parents, names, executable)]
947
            file_id     Simple file_id of the entry
948
            changed     Boolean, True if the kind or contents changed
949
                        else False
950
            parents     ((base, [parent_id, in, lcas]), parent_id_other,
951
                         parent_id_this)
952
            names       ((base, [name, in, lcas]), name_in_other, name_in_this)
953
            executable  ((base, [exec, in, lcas]), exec_in_other, exec_in_this)
954
        """
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
955
        if self.interesting_files is not None:
956
            lookup_trees = [self.this_tree, self.base_tree]
957
            lookup_trees.extend(self._lca_trees)
958
            # I think we should include the lca trees as well
959
            interesting_ids = self.other_tree.paths2ids(self.interesting_files,
960
                                                        lookup_trees)
961
        else:
962
            interesting_ids = self.interesting_ids
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
963
        result = []
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
964
        walker = _mod_tree.MultiWalker(self.other_tree, self._lca_trees)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
965
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
966
        base_inventory = self.base_tree.inventory
967
        this_inventory = self.this_tree.inventory
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
968
        for path, file_id, other_ie, lca_values in walker.iter_all():
969
            # Is this modified at all from any of the other trees?
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
970
            if other_ie is None:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
971
                other_ie = _none_entry
3514.4.24 by John Arbash Meinel
Implement support for 'interesting_files' and 'interesting_ids' for _entries_lca
972
            if interesting_ids is not None and file_id not in interesting_ids:
973
                continue
3514.4.15 by John Arbash Meinel
Handle when OTHER doesn't have the entry.
974
3514.4.30 by John Arbash Meinel
Several updates.
975
            # If other_revision is found in any of the lcas, that means this
976
            # node is uninteresting. This is because when merging, if there are
977
            # multiple heads(), we have to create a new node. So if we didn't,
978
            # we know that the ancestry is linear, and that OTHER did not
979
            # modify anything
980
            # See doc/developers/lca_merge_resolution.txt for details
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
981
            other_revision = other_ie.revision
3514.4.32 by John Arbash Meinel
Add a test for proper behavior when *everything* is a WT.
982
            if other_revision is not None:
983
                # We can't use this shortcut when other_revision is None,
984
                # because it may be None because things are WorkingTrees, and
985
                # not because it is *actually* None.
986
                is_unmodified = False
987
                for lca_path, ie in lca_values:
988
                    if ie is not None and ie.revision == other_revision:
989
                        is_unmodified = True
990
                        break
991
                if is_unmodified:
992
                    continue
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
993
994
            lca_entries = []
995
            for lca_path, lca_ie in lca_values:
996
                if lca_ie is None:
997
                    lca_entries.append(_none_entry)
998
                else:
999
                    lca_entries.append(lca_ie)
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1000
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
1001
            if file_id in base_inventory:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1002
                base_ie = base_inventory[file_id]
3514.4.10 by John Arbash Meinel
Test the case where BASE is missing a file that is present in THIS, OTHER and all LCAs.
1003
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1004
                base_ie = _none_entry
1005
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
1006
            if file_id in this_inventory:
1007
                this_ie = this_inventory[file_id]
1008
            else:
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1009
                this_ie = _none_entry
3514.4.11 by John Arbash Meinel
Handle when an entry is missing in THIS
1010
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1011
            lca_kinds = []
1012
            lca_parent_ids = []
1013
            lca_names = []
1014
            lca_executable = []
1015
            for lca_ie in lca_entries:
1016
                lca_kinds.append(lca_ie.kind)
1017
                lca_parent_ids.append(lca_ie.parent_id)
1018
                lca_names.append(lca_ie.name)
1019
                lca_executable.append(lca_ie.executable)
1020
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1021
            kind_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1022
                (base_ie.kind, lca_kinds),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1023
                other_ie.kind, this_ie.kind)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1024
            parent_id_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1025
                (base_ie.parent_id, lca_parent_ids),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1026
                other_ie.parent_id, this_ie.parent_id)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1027
            name_winner = self._lca_multi_way(
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1028
                (base_ie.name, lca_names),
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1029
                other_ie.name, this_ie.name)
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1030
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1031
            content_changed = True
1032
            if kind_winner == 'this':
1033
                # No kind change in OTHER, see if there are *any* changes
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1034
                if other_ie.kind == 'directory':
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1035
                    if parent_id_winner == 'this' and name_winner == 'this':
1036
                        # No change for this directory in OTHER, skip
1037
                        continue
1038
                    content_changed = False
3948.1.1 by John Arbash Meinel
Fix an edge case with deleted files and criss-cross merges.
1039
                elif other_ie.kind is None or other_ie.kind == 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1040
                    def get_sha1(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1041
                        if ie.kind != 'file':
3514.4.30 by John Arbash Meinel
Several updates.
1042
                            return None
1043
                        return tree.get_file_sha1(file_id)
1044
                    base_sha1 = get_sha1(base_ie, self.base_tree)
1045
                    lca_sha1s = [get_sha1(ie, tree) for ie, tree
1046
                                 in zip(lca_entries, self._lca_trees)]
1047
                    this_sha1 = get_sha1(this_ie, self.this_tree)
1048
                    other_sha1 = get_sha1(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1049
                    sha1_winner = self._lca_multi_way(
3514.4.30 by John Arbash Meinel
Several updates.
1050
                        (base_sha1, lca_sha1s), other_sha1, this_sha1,
1051
                        allow_overriding_lca=False)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1052
                    exec_winner = self._lca_multi_way(
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1053
                        (base_ie.executable, lca_executable),
1054
                        other_ie.executable, this_ie.executable)
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1055
                    if (parent_id_winner == 'this' and name_winner == 'this'
3514.4.22 by John Arbash Meinel
Handle executable bit changes as well.
1056
                        and sha1_winner == 'this' and exec_winner == 'this'):
1057
                        # No kind, parent, name, exec, or content change for
1058
                        # OTHER, so this node is not considered interesting
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1059
                        continue
1060
                    if sha1_winner == 'this':
1061
                        content_changed = False
3514.4.27 by John Arbash Meinel
A couple of symlink tests, we need to do more.
1062
                elif other_ie.kind == 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1063
                    def get_target(ie, tree):
3514.4.35 by John Arbash Meinel
Add a test that we only call get_symlink_target if the object should be a symlink.
1064
                        if ie.kind != 'symlink':
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1065
                            return None
1066
                        return tree.get_symlink_target(file_id)
1067
                    base_target = get_target(base_ie, self.base_tree)
1068
                    lca_targets = [get_target(ie, tree) for ie, tree
1069
                                   in zip(lca_entries, self._lca_trees)]
1070
                    this_target = get_target(this_ie, self.this_tree)
1071
                    other_target = get_target(other_ie, self.other_tree)
3514.4.39 by John Arbash Meinel
Use self._lca_multi_way rather than Merge3Merger._lca_multi_way by Aaron's request.
1072
                    target_winner = self._lca_multi_way(
3514.4.34 by John Arbash Meinel
Handle symlinks properly when objects are not RevisionTrees
1073
                        (base_target, lca_targets),
1074
                        other_target, this_target)
3514.4.28 by John Arbash Meinel
More symlink tests.
1075
                    if (parent_id_winner == 'this' and name_winner == 'this'
1076
                        and target_winner == 'this'):
1077
                        # No kind, parent, name, or symlink target change
1078
                        # not interesting
1079
                        continue
1080
                    if target_winner == 'this':
1081
                        content_changed = False
3514.4.33 by John Arbash Meinel
Implement support for 'tree-reference'.
1082
                elif other_ie.kind == 'tree-reference':
1083
                    # The 'changed' information seems to be handled at a higher
1084
                    # level. At least, _entries3 returns False for content
1085
                    # changed, even when at a new revision_id.
1086
                    content_changed = False
1087
                    if (parent_id_winner == 'this' and name_winner == 'this'):
1088
                        # Nothing interesting
1089
                        continue
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1090
                else:
1091
                    raise AssertionError('unhandled kind: %s' % other_ie.kind)
3514.4.13 by John Arbash Meinel
Switch the lca_trees to be in 'find_merge_order'.
1092
1093
            # If we have gotten this far, that means something has changed
3514.4.20 by John Arbash Meinel
Use the _lca_multi_way to work out if there is actually a kind/parent/name/content change.
1094
            result.append((file_id, content_changed,
1095
                           ((base_ie.parent_id, lca_parent_ids),
1096
                            other_ie.parent_id, this_ie.parent_id),
1097
                           ((base_ie.name, lca_names),
1098
                            other_ie.name, this_ie.name),
1099
                           ((base_ie.executable, lca_executable),
1100
                            other_ie.executable, this_ie.executable)
3514.4.5 by John Arbash Meinel
Initial work on _entries_lca.
1101
                          ))
1102
        return result
1103
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1104
    def fix_root(self):
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1105
        if self.tt.final_kind(self.tt.root) is None:
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1106
            self.tt.cancel_deletion(self.tt.root)
1107
        if self.tt.final_file_id(self.tt.root) is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1108
            self.tt.version_file(self.tt.tree_file_id(self.tt.root),
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1109
                                 self.tt.root)
2946.3.3 by John Arbash Meinel
Prefer tree.get_root_id() as more explicit than tree.path2id('')
1110
        other_root_file_id = self.other_tree.get_root_id()
3363.17.17 by Aaron Bentley
Start testing merging PreviewTree as OTHER
1111
        if other_root_file_id is None:
1112
            return
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1113
        other_root = self.tt.trans_id_file_id(other_root_file_id)
1114
        if other_root == self.tt.root:
1115
            return
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
1116
        if self.other_tree.inventory.root.file_id in self.this_tree.inventory:
4634.149.3 by Vincent Ladeuil
Fix bug #3735898 by filtering out garbage paths.
1117
            # the other tree's root is a non-root in the current tree (as when
4634.149.6 by Vincent Ladeuil
Fix typo.
1118
            # a previously unrelated branch is merged into another)
3649.3.1 by Jelmer Vernooij
Merging from a previously joined branch will no longer cause a traceback.
1119
            return
4597.9.9 by Vincent Ladeuil
Fix wrong conflict resolution (thanks to test coverage...).
1120
        if self.tt.final_kind(other_root) is not None:
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1121
            other_root_is_present = True
4597.9.8 by Vincent Ladeuil
Merge bzr.dev into cleanup
1122
        else:
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1123
            # other_root doesn't have a physical representation. We still need
1124
            # to move any references to the actual root of the tree.
1125
            other_root_is_present = False
1126
        # 'other_tree.inventory.root' is not present in this tree. We are
1127
        # calling adjust_path for children which *want* to be present with a
1128
        # correct place to go.
1129
        for thing, child in self.other_tree.inventory.root.children.iteritems():
1130
            trans_id = self.tt.trans_id_file_id(child.file_id)
1131
            if not other_root_is_present:
4597.9.8 by Vincent Ladeuil
Merge bzr.dev into cleanup
1132
                if self.tt.final_kind(trans_id) is not None:
4634.149.5 by Vincent Ladeuil
Fixed as per John's review comments.
1133
                    # The item exist in the final tree and has a defined place
1134
                    # to go already.
1135
                    continue
1136
            # Move the item into the root
1137
            self.tt.adjust_path(self.tt.final_name(trans_id),
1138
                                self.tt.root, trans_id)
1139
        if other_root_is_present:
4634.149.3 by Vincent Ladeuil
Fix bug #3735898 by filtering out garbage paths.
1140
            self.tt.cancel_creation(other_root)
1141
            self.tt.cancel_versioning(other_root)
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1142
1534.7.192 by Aaron Bentley
Record hashes produced by merges
1143
    def write_modified(self, results):
1144
        modified_hashes = {}
1145
        for path in results.modified_paths:
1146
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
1147
            if file_id is None:
1148
                continue
1149
            hash = self.this_tree.get_file_sha1(file_id)
1150
            if hash is None:
1151
                continue
1152
            modified_hashes[file_id] = hash
1153
        self.this_tree.set_merge_modified(modified_hashes)
1154
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1155
    @staticmethod
1156
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1157
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1158
        if entry is None:
1159
            return None
1160
        return entry.parent_id
1161
1162
    @staticmethod
1163
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1164
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1165
        if entry is None:
1166
            return None
1167
        return entry.name
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1168
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1169
    @staticmethod
1170
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1171
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1172
        if file_id not in tree:
1173
            return None
1174
        return tree.get_file_sha1(file_id)
1175
1176
    @staticmethod
1177
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1178
        """Determine the executability of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1179
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1180
            return None
1181
        if tree.kind(file_id) != "file":
1182
            return False
1183
        return tree.is_executable(file_id)
1184
1185
    @staticmethod
1186
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1187
        """Determine the kind of a file-id (used as a key method)."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1188
        if not tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1189
            return None
1190
        return tree.kind(file_id)
1191
1192
    @staticmethod
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1193
    def _three_way(base, other, this):
1194
        if base == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1195
            # if 'base == other', either they all agree, or only 'this' has
1196
            # changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1197
            return 'this'
2590.2.10 by Aaron Bentley
Updates from review
1198
        elif this not in (base, other):
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1199
            # 'this' is neither 'base' nor 'other', so both sides changed
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1200
            return 'conflict'
1201
        elif this == other:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1202
            # "Ambiguous clean merge" -- both sides have made the same change.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1203
            return "this"
1204
        else:
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1205
            # this == base: only other has changed.
2590.2.8 by Aaron Bentley
Restore conflict handling changes
1206
            return "other"
1207
1208
    @staticmethod
3514.4.30 by John Arbash Meinel
Several updates.
1209
    def _lca_multi_way(bases, other, this, allow_overriding_lca=True):
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1210
        """Consider LCAs when determining whether a change has occurred.
1211
1212
        If LCAS are all identical, this is the same as a _three_way comparison.
1213
1214
        :param bases: value in (BASE, [LCAS])
1215
        :param other: value in OTHER
1216
        :param this: value in THIS
3514.4.30 by John Arbash Meinel
Several updates.
1217
        :param allow_overriding_lca: If there is more than one unique lca
1218
            value, allow OTHER to override THIS if it has a new value, and
1219
            THIS only has an lca value, or vice versa. This is appropriate for
1220
            truly scalar values, not as much for non-scalars.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1221
        :return: 'this', 'other', or 'conflict' depending on whether an entry
1222
            changed or not.
1223
        """
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1224
        # See doc/developers/lca_tree_merging.txt for details about this
3514.4.30 by John Arbash Meinel
Several updates.
1225
        # algorithm.
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1226
        if other == this:
1227
            # Either Ambiguously clean, or nothing was actually changed. We
1228
            # don't really care
1229
            return 'this'
1230
        base_val, lca_vals = bases
1231
        # Remove 'base_val' from the lca_vals, because it is not interesting
1232
        filtered_lca_vals = [lca_val for lca_val in lca_vals
1233
                                      if lca_val != base_val]
1234
        if len(filtered_lca_vals) == 0:
1235
            return Merge3Merger._three_way(base_val, other, this)
3514.4.30 by John Arbash Meinel
Several updates.
1236
1237
        unique_lca_vals = set(filtered_lca_vals)
1238
        if len(unique_lca_vals) == 1:
1239
            return Merge3Merger._three_way(unique_lca_vals.pop(), other, this)
1240
1241
        if allow_overriding_lca:
1242
            if other in unique_lca_vals:
1243
                if this in unique_lca_vals:
1244
                    # Each side picked a different lca, conflict
1245
                    return 'conflict'
1246
                else:
1247
                    # This has a value which supersedes both lca values, and
1248
                    # other only has an lca value
1249
                    return 'this'
1250
            elif this in unique_lca_vals:
1251
                # OTHER has a value which supersedes both lca values, and this
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1252
                # only has an lca value
3514.4.30 by John Arbash Meinel
Several updates.
1253
                return 'other'
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1254
5128.1.1 by Vincent Ladeuil
Uncontroversial cleanups, mostly comments
1255
        # At this point, the lcas disagree, and the tip disagree
3514.4.19 by John Arbash Meinel
Add the _lca_multi_way function, and explicit tests.
1256
        return 'conflict'
1257
1258
    @staticmethod
5077.2.1 by Vincent Ladeuil
Deprecate Merge3Merger.scalar_three_way.
1259
    @deprecated_method(deprecated_in((2, 2, 0)))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1260
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
1261
        """Do a three-way test on a scalar.
1262
        Return "this", "other" or "conflict", depending whether a value wins.
1263
        """
1264
        key_base = key(base_tree, file_id)
1265
        key_other = key(other_tree, file_id)
1266
        #if base == other, either they all agree, or only THIS has changed.
1267
        if key_base == key_other:
1268
            return "this"
1269
        key_this = key(this_tree, file_id)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1270
        # "Ambiguous clean merge"
1271
        if key_this == key_other:
1272
            return "this"
1273
        elif key_this == key_base:
1274
            return "other"
1275
        else:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1276
            return "conflict"
1277
1278
    def merge_names(self, file_id):
1279
        def get_entry(tree):
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1280
            if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1281
                return tree.inventory[file_id]
1282
            else:
1283
                return None
1284
        this_entry = get_entry(self.this_tree)
1285
        other_entry = get_entry(self.other_tree)
1286
        base_entry = get_entry(self.base_tree)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1287
        entries = (base_entry, other_entry, this_entry)
1288
        names = []
1289
        parents = []
1290
        for entry in entries:
1291
            if entry is None:
1292
                names.append(None)
1293
                parents.append(None)
1294
            else:
1295
                names.append(entry.name)
1296
                parents.append(entry.parent_id)
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1297
        return self._merge_names(file_id, parents, names,
1298
                                 resolver=self._three_way)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1299
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1300
    def _merge_names(self, file_id, parents, names, resolver):
2590.2.7 by Aaron Bentley
Misc cleanup
1301
        """Perform a merge on file_id names and parents"""
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1302
        base_name, other_name, this_name = names
1303
        base_parent, other_parent, this_parent = parents
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1304
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1305
        name_winner = resolver(*names)
2590.2.1 by Aaron Bentley
Start work on merging names based on iter_changes
1306
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1307
        parent_id_winner = resolver(*parents)
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1308
        if this_name is None:
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1309
            if name_winner == "this":
1310
                name_winner = "other"
1311
            if parent_id_winner == "this":
1312
                parent_id_winner = "other"
1313
        if name_winner == "this" and parent_id_winner == "this":
1314
            return
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1315
        if name_winner == 'conflict' or parent_id_winner == 'conflict':
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1316
            # Creating helpers (.OTHER or .THIS) here cause problems down the
1317
            # road if a ContentConflict needs to be created so we should not do
1318
            # that
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1319
            trans_id = self.tt.trans_id_file_id(file_id)
1320
            self._raw_conflicts.append(('path conflict', trans_id, file_id,
1321
                                        this_parent, this_name,
1322
                                        other_parent, other_name))
2590.2.2 by Aaron Bentley
Do most name merging from iter_changes output
1323
        if other_name is None:
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1324
            # it doesn't matter whether the result was 'other' or
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1325
            # 'conflict'-- if there's no 'other', we leave it alone.
1326
            return
2590.2.7 by Aaron Bentley
Misc cleanup
1327
        parent_id = parents[self.winner_idx[parent_id_winner]]
1731.1.33 by Aaron Bentley
Revert no-special-root changes
1328
        if parent_id is not None:
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1329
            # if we get here, name_winner and parent_winner are set to safe
1330
            # values.
2590.2.7 by Aaron Bentley
Misc cleanup
1331
            self.tt.adjust_path(names[self.winner_idx[name_winner]],
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1332
                                self.tt.trans_id_file_id(parent_id),
1333
                                self.tt.trans_id_file_id(file_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1334
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1335
    def _do_merge_contents(self, file_id):
3874.2.10 by Vincent Ladeuil
Fix typo.
1336
        """Performs a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1337
        def contents_pair(tree):
1338
            if file_id not in tree:
1339
                return (None, None)
1340
            kind = tree.kind(file_id)
1341
            if kind == "file":
1342
                contents = tree.get_file_sha1(file_id)
1343
            elif kind == "symlink":
1344
                contents = tree.get_symlink_target(file_id)
1345
            else:
1346
                contents = None
1347
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
1348
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1349
        # See SPOT run.  run, SPOT, run.
1350
        # So we're not QUITE repeating ourselves; we do tricky things with
1351
        # file kind...
1352
        base_pair = contents_pair(self.base_tree)
1353
        other_pair = contents_pair(self.other_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1354
        if self._lca_trees:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1355
            this_pair = contents_pair(self.this_tree)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1356
            lca_pairs = [contents_pair(tree) for tree in self._lca_trees]
1357
            winner = self._lca_multi_way((base_pair, lca_pairs), other_pair,
1358
                                         this_pair, allow_overriding_lca=False)
1359
        else:
3948.1.7 by Vincent Ladeuil
Slight refactoring and test fixing.
1360
            if base_pair == other_pair:
1361
                winner = 'this'
1362
            else:
1363
                # We delayed evaluating this_pair as long as we can to avoid
1364
                # unnecessary sha1 calculation
1365
                this_pair = contents_pair(self.this_tree)
1366
                winner = self._three_way(base_pair, other_pair, this_pair)
3955.2.1 by John Arbash Meinel
Change the workings of merge_content to be lca aware.
1367
        if winner == 'this':
1368
            # No interesting changes introduced by OTHER
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1369
            return "unmodified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1370
        # We have a hypothetical conflict, but if we have files, then we
1371
        # can try to merge the content
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1372
        trans_id = self.tt.trans_id_file_id(file_id)
4869.3.21 by Andrew Bennetts
Pass kinds (not pairs) to MergeHookParams.
1373
        params = MergeHookParams(self, file_id, trans_id, this_pair[0],
1374
            other_pair[0], winner)
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1375
        hooks = self.active_hooks
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1376
        hook_status = 'not_applicable'
1377
        for hook in hooks:
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1378
            hook_status, lines = hook.merge_contents(params)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1379
            if hook_status != 'not_applicable':
1380
                # Don't try any more hooks, this one applies.
4869.3.5 by Andrew Bennetts
Hook is invoked for delete vs. change conflicts, and may choose to result in deleting the file.
1381
                break
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1382
        result = "modified"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1383
        if hook_status == 'not_applicable':
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1384
            # This is a contents conflict, because none of the available
1385
            # functions could merge it.
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1386
            result = None
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1387
            name = self.tt.final_name(trans_id)
1388
            parent_id = self.tt.final_parent(trans_id)
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1389
            if self.this_tree.has_id(file_id):
4869.3.17 by Andrew Bennetts
Remove contents_conflict nested function, replace last callsite with simpler form.
1390
                self.tt.unversion_file(trans_id)
1391
            file_group = self._dump_conflicts(name, parent_id, file_id,
1392
                                              set_version=True)
1393
            self._raw_conflicts.append(('contents conflict', file_group))
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1394
        elif hook_status == 'success':
1395
            self.tt.create_file(lines, trans_id)
1396
        elif hook_status == 'conflicted':
1397
            # XXX: perhaps the hook should be able to provide
1398
            # the BASE/THIS/OTHER files?
1399
            self.tt.create_file(lines, trans_id)
1400
            self._raw_conflicts.append(('text conflict', trans_id))
1401
            name = self.tt.final_name(trans_id)
1402
            parent_id = self.tt.final_parent(trans_id)
4869.3.23 by Andrew Bennetts
Remove some confusing code that has no effect.
1403
            self._dump_conflicts(name, parent_id, file_id)
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1404
        elif hook_status == 'delete':
1405
            self.tt.unversion_file(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1406
            result = "deleted"
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1407
        elif hook_status == 'done':
1408
            # The hook function did whatever it needs to do directly, no
1409
            # further action needed here.
1410
            pass
1411
        else:
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1412
            raise AssertionError('unknown hook_status: %r' % (hook_status,))
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1413
        if not self.this_tree.has_id(file_id) and result == "modified":
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1414
            self.tt.version_file(file_id, trans_id)
4869.3.31 by Andrew Bennetts
Add comment, improve doc string, remove redundant line.
1415
        # The merge has been performed, so the old contents should not be
1416
        # retained.
4597.9.13 by Vincent Ladeuil
bzrlib.transform.TreeTransform.tree_kind and
1417
        self.tt.delete_contents(trans_id)
4869.3.18 by Andrew Bennetts
Simplify slightly more.
1418
        return result
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1419
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1420
    def _default_other_winner_merge(self, merge_hook_params):
1421
        """Replace this contents with other."""
1422
        file_id = merge_hook_params.file_id
1423
        trans_id = merge_hook_params.trans_id
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1424
        file_in_this = self.this_tree.has_id(file_id)
1425
        if self.other_tree.has_id(file_id):
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1426
            # OTHER changed the file
1427
            wt = self.this_tree
1428
            if wt.supports_content_filtering():
1429
                # We get the path from the working tree if it exists.
1430
                # That fails though when OTHER is adding a file, so
1431
                # we fall back to the other tree to find the path if
1432
                # it doesn't exist locally.
1433
                try:
1434
                    filter_tree_path = wt.id2path(file_id)
1435
                except errors.NoSuchId:
1436
                    filter_tree_path = self.other_tree.id2path(file_id)
1437
            else:
1438
                # Skip the id2path lookup for older formats
1439
                filter_tree_path = None
1440
            transform.create_from_tree(self.tt, trans_id,
1441
                             self.other_tree, file_id,
1442
                             filter_tree_path=filter_tree_path)
1443
            return 'done', None
1444
        elif file_in_this:
1445
            # OTHER deleted the file
1446
            return 'delete', None
1447
        else:
1448
            raise AssertionError(
1449
                'winner is OTHER, but file_id %r not in THIS or OTHER tree'
1450
                % (file_id,))
1451
4797.5.1 by Robert Collins
Support state on per-file merging to permit more efficient use of configuration data.
1452
    def merge_contents(self, merge_hook_params):
1453
        """Fallback merge logic after user installed hooks."""
1454
        # This function is used in merge hooks as the fallback instance.
1455
        # Perhaps making this function and the functions it calls be a 
1456
        # a separate class would be better.
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1457
        if merge_hook_params.winner == 'other':
1458
            # OTHER is a straight winner, so replace this contents with other
1459
            return self._default_other_winner_merge(merge_hook_params)
1460
        elif merge_hook_params.is_file_merge():
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1461
            # THIS and OTHER are both files, so text merge.  Either
1462
            # BASE is a file, or both converted to files, so at least we
1463
            # have agreement that output should be a file.
1464
            try:
1465
                self.text_merge(merge_hook_params.file_id,
1466
                    merge_hook_params.trans_id)
1467
            except errors.BinaryFile:
1468
                return 'not_applicable', None
4869.3.16 by Andrew Bennetts
Move handling of winner==OTHER case into generic hook path too.
1469
            return 'done', None
4869.3.15 by Andrew Bennetts
Refactor so that the default text merge is the final hook tried. Other hooks can now invoke it directly via merger.default_text_merge if they wish.
1470
        else:
1471
            return 'not_applicable', None
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1472
1473
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
1474
        """Return the lines in a file, or an empty list."""
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1475
        if tree.has_id(file_id):
4708.2.1 by Martin
Ensure all files opened by bazaar proper are explicitly closed
1476
            return tree.get_file_lines(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1477
        else:
1478
            return []
1479
1480
    def text_merge(self, file_id, trans_id):
1481
        """Perform a three-way text merge on a file_id"""
1482
        # it's possible that we got here with base as a different type.
1483
        # if so, we just want two-way text conflicts.
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1484
        if self.base_tree.has_id(file_id) and \
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1485
            self.base_tree.kind(file_id) == "file":
1486
            base_lines = self.get_lines(self.base_tree, file_id)
1487
        else:
1488
            base_lines = []
1489
        other_lines = self.get_lines(self.other_tree, file_id)
1490
        this_lines = self.get_lines(self.this_tree, file_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1491
        m3 = merge3.Merge3(base_lines, this_lines, other_lines,
1492
                           is_cherrypick=self.cherrypick)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1493
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
1494
        if self.show_base is True:
1495
            base_marker = '|' * 7
1496
        else:
1497
            base_marker = None
1498
1499
        def iter_merge3(retval):
1500
            retval["text_conflicts"] = False
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1501
            for line in m3.merge_lines(name_a = "TREE",
1502
                                       name_b = "MERGE-SOURCE",
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1503
                                       name_base = "BASE-REVISION",
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1504
                                       start_marker=start_marker,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1505
                                       base_marker=base_marker,
1506
                                       reprocess=self.reprocess):
1507
                if line.startswith(start_marker):
1508
                    retval["text_conflicts"] = True
1509
                    yield line.replace(start_marker, '<' * 7)
1510
                else:
1511
                    yield line
1512
        retval = {}
1513
        merge3_iterator = iter_merge3(retval)
1514
        self.tt.create_file(merge3_iterator, trans_id)
1515
        if retval["text_conflicts"] is True:
1516
            self._raw_conflicts.append(('text conflict', trans_id))
1517
            name = self.tt.final_name(trans_id)
1518
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1519
            file_group = self._dump_conflicts(name, parent_id, file_id,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1520
                                              this_lines, base_lines,
1521
                                              other_lines)
1522
            file_group.append(trans_id)
1523
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1524
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1525
                        base_lines=None, other_lines=None, set_version=False,
1526
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
1527
        """Emit conflict files.
1528
        If this_lines, base_lines, or other_lines are omitted, they will be
1529
        determined automatically.  If set_version is true, the .OTHER, .THIS
1530
        or .BASE (in that order) will be created as versioned files.
1531
        """
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1532
        data = [('OTHER', self.other_tree, other_lines),
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1533
                ('THIS', self.this_tree, this_lines)]
1534
        if not no_base:
1535
            data.append(('BASE', self.base_tree, base_lines))
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1536
1537
        # We need to use the actual path in the working tree of the file here,
1538
        # ignoring the conflict suffixes
1539
        wt = self.this_tree
1540
        if wt.supports_content_filtering():
1541
            try:
1542
                filter_tree_path = wt.id2path(file_id)
1543
            except errors.NoSuchId:
1544
                # file has been deleted
1545
                filter_tree_path = None
1546
        else:
1547
            # Skip the id2path lookup for older formats
1548
            filter_tree_path = None
1549
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1550
        versioned = False
1551
        file_group = []
1552
        for suffix, tree, lines in data:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1553
            if tree.has_id(file_id):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1554
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1555
                                               suffix, lines, filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1556
                file_group.append(trans_id)
1557
                if set_version and not versioned:
1558
                    self.tt.version_file(file_id, trans_id)
1559
                    versioned = True
1560
        return file_group
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1561
3363.17.21 by Aaron Bentley
Conflicts are handled when merging from preview trees
1562
    def _conflict_file(self, name, parent_id, tree, file_id, suffix,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1563
                       lines=None, filter_tree_path=None):
1534.7.157 by Aaron Bentley
Added more docs
1564
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1565
        name = name + '.' + suffix
1566
        trans_id = self.tt.create_path(name, parent_id)
4854.1.1 by Andrew Bennetts
Merge lp:bzr/2.0 into lp:bzr.
1567
        transform.create_from_tree(self.tt, trans_id, tree, file_id, lines,
4443.2.1 by Ian Clatworthy
apply content filters when merging new files
1568
            filter_tree_path)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1569
        return trans_id
1570
1571
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
1572
        """Perform a merge on the execute bit."""
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1573
        executable = [self.executable(t, file_id) for t in (self.base_tree,
1574
                      self.other_tree, self.this_tree)]
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1575
        self._merge_executable(file_id, executable, file_status,
1576
                               resolver=self._three_way)
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1577
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1578
    def _merge_executable(self, file_id, executable, file_status,
3514.4.40 by John Arbash Meinel
Make 'resolver' a required parameter.
1579
                          resolver):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1580
        """Perform a merge on the execute bit."""
1581
        base_executable, other_executable, this_executable = executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1582
        if file_status == "deleted":
1583
            return
3514.4.21 by John Arbash Meinel
Hook up the lca-way logic into the path handlers.
1584
        winner = resolver(*executable)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1585
        if winner == "conflict":
1586
        # There must be a None in here, if we have a conflict, but we
1587
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
1588
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1589
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1590
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
1591
                winner = "other"
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1592
        if winner == 'this' and file_status != "modified":
1593
            return
1594
        trans_id = self.tt.trans_id_file_id(file_id)
4597.9.7 by Vincent Ladeuil
transform.final_kind() now returns None instead of raising NoSuchFile.
1595
        if self.tt.final_kind(trans_id) != "file":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1596
            return
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1597
        if winner == "this":
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1598
            executability = this_executable
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1599
        else:
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1600
            if self.other_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1601
                executability = other_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1602
            elif self.this_tree.has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1603
                executability = this_executable
4869.3.22 by Andrew Bennetts
Use 'tree.has_id(file_id)' rather than using 'file_id in tree' or using tree.inventory.
1604
            elif self.base_tree_has_id(file_id):
2590.2.3 by Aaron Bentley
Merge the execute bit based on iter_changes
1605
                executability = base_executable
1551.19.30 by Aaron Bentley
Accelerate merge by skipping file existence check when merging execute bit
1606
        if executability is not None:
1607
            trans_id = self.tt.trans_id_file_id(file_id)
1608
            self.tt.set_executability(executability, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1609
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
1610
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1611
        """Convert all conflicts into a form that doesn't depend on trans_id"""
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1612
        self.cooked_conflicts.extend(transform.cook_conflicts(
1613
                fs_conflicts, self.tt))
1614
        fp = transform.FinalPaths(self.tt)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1615
        for conflict in self._raw_conflicts:
1616
            conflict_type = conflict[0]
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1617
            if conflict_type == 'path conflict':
1618
                (trans_id, file_id,
1619
                this_parent, this_name,
1620
                other_parent, other_name) = conflict[1:]
1621
                if this_parent is None or this_name is None:
1622
                    this_path = '<deleted>'
1623
                else:
1624
                    parent_path =  fp.get_path(
1625
                        self.tt.trans_id_file_id(this_parent))
1626
                    this_path = osutils.pathjoin(parent_path, this_name)
1627
                if other_parent is None or other_name is None:
1628
                    other_path = '<deleted>'
1629
                else:
1630
                    parent_path =  fp.get_path(
1631
                        self.tt.trans_id_file_id(other_parent))
1632
                    other_path = osutils.pathjoin(parent_path, other_name)
1633
                c = _mod_conflicts.Conflict.factory(
1634
                    'path conflict', path=this_path,
1635
                    conflict_path=other_path,
1636
                    file_id=file_id)
1637
            elif conflict_type == 'contents conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1638
                for trans_id in conflict[1]:
1639
                    file_id = self.tt.final_file_id(trans_id)
1640
                    if file_id is not None:
1641
                        break
1642
                path = fp.get_path(trans_id)
1643
                for suffix in ('.BASE', '.THIS', '.OTHER'):
1644
                    if path.endswith(suffix):
1645
                        path = path[:-len(suffix)]
1646
                        break
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1647
                c = _mod_conflicts.Conflict.factory(conflict_type,
1648
                                                    path=path, file_id=file_id)
4597.7.11 by Vincent Ladeuil
Fix #531967 by creating helpers for PathConflicts when a deletion
1649
            elif conflict_type == 'text conflict':
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1650
                trans_id = conflict[1]
1651
                path = fp.get_path(trans_id)
1652
                file_id = self.tt.final_file_id(trans_id)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1653
                c = _mod_conflicts.Conflict.factory(conflict_type,
1654
                                                    path=path, file_id=file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1655
            else:
4597.7.18 by Vincent Ladeuil
Start addressing Andrew's concerns.
1656
                raise AssertionError('bad conflict type: %r' % (conflict,))
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
1657
            self.cooked_conflicts.append(c)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1658
        self.cooked_conflicts.sort(key=_mod_conflicts.Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
1659
1660
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1661
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1662
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
1663
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1664
    supports_show_base = False
3062.2.7 by Aaron Bentley
Prevent reverse cherry-picking with weave
1665
    supports_reverse_cherrypick = False
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1666
    history_based = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1667
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1668
    def _generate_merge_plan(self, file_id, base):
1669
        return self.this_tree.plan_file_merge(file_id, self.other_tree,
3062.2.9 by Aaron Bentley
Don't use the base if not cherrypicking
1670
                                              base=base)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1671
1672
    def _merged_lines(self, file_id):
1673
        """Generate the merged lines.
1674
        There is no distinction between lines that are meant to contain <<<<<<<
1675
        and conflicts.
1676
        """
1677
        if self.cherrypick:
1678
            base = self.base_tree
1679
        else:
1680
            base = None
1681
        plan = self._generate_merge_plan(file_id, base)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1682
        if 'merge' in debug.debug_flags:
1683
            plan = list(plan)
1684
            trans_id = self.tt.trans_id_file_id(file_id)
1685
            name = self.tt.final_name(trans_id) + '.plan'
4634.101.6 by John Arbash Meinel
killed-both and killed-base is 11 chars long.
1686
            contents = ('%11s|%s' % l for l in plan)
1551.19.17 by Aaron Bentley
Add debugging flag for merges
1687
            self.tt.new_file(name, self.tt.final_parent(trans_id), contents)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1688
        textmerge = versionedfile.PlanWeaveMerge(plan, '<<<<<<< TREE\n',
1689
                                                 '>>>>>>> MERGE-SOURCE\n')
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1690
        lines, conflicts = textmerge.merge_lines(self.reprocess)
1691
        if conflicts:
1692
            base_lines = textmerge.base_from_plan()
1693
        else:
1694
            base_lines = None
1695
        return lines, base_lines
4869.2.2 by Andrew Bennetts
Remove some duplication.
1696
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1697
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1698
        """Perform a (weave) text merge for a given file and file-id.
1699
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
1700
        and a conflict will be noted.
1701
        """
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1702
        lines, base_lines = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
1703
        lines = list(lines)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1704
        # Note we're checking whether the OUTPUT is binary in this case,
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
1705
        # because we don't want to get into weave merge guts.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1706
        textfile.check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1707
        self.tt.create_file(lines, trans_id)
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1708
        if base_lines is not None:
1709
            # Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1710
            self._raw_conflicts.append(('text conflict', trans_id))
1711
            name = self.tt.final_name(trans_id)
1712
            parent_id = self.tt.final_parent(trans_id)
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1713
            file_group = self._dump_conflicts(name, parent_id, file_id,
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1714
                                              no_base=False,
1715
                                              base_lines=base_lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1716
            file_group.append(trans_id)
1717
1718
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1719
class LCAMerger(WeaveMerger):
1720
4634.101.7 by John Arbash Meinel
Start working on the ability to drop a .BASE file for --weave and --lca merge.
1721
    def _generate_merge_plan(self, file_id, base):
1722
        return self.this_tree.plan_file_lca_merge(file_id, self.other_tree,
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
1723
                                                  base=base)
1724
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1725
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
1726
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1727
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1728
    def dump_file(self, temp_dir, name, tree, file_id):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1729
        out_path = osutils.pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1730
        out_file = open(out_path, "wb")
1731
        try:
1732
            in_file = tree.get_file(file_id)
1733
            for line in in_file:
1734
                out_file.write(line)
1735
        finally:
1736
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1737
        return out_path
1738
1739
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
1740
        """Perform a diff3 merge using a specified file-id and trans-id.
1741
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
1742
        will be dumped, and a will be conflict noted.
1743
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1744
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1745
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1746
        try:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1747
            new_file = osutils.pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1748
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
1749
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
1750
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
1751
            status = bzrlib.patch.diff3(new_file, this, base, other)
1752
            if status not in (0, 1):
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1753
                raise errors.BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
1754
            f = open(new_file, 'rb')
1755
            try:
1756
                self.tt.create_file(f, trans_id)
1757
            finally:
1758
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1759
            if status == 1:
1760
                name = self.tt.final_name(trans_id)
1761
                parent_id = self.tt.final_parent(trans_id)
1762
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
1763
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1764
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
1765
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1766
1767
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1768
class PathNotInTree(errors.BzrError):
1769
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1770
    _fmt = """Merge-into failed because %(tree)s does not contain %(path)s."""
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1771
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1772
    def __init__(self, path, tree):
1773
        errors.BzrError.__init__(self, path=path, tree=tree)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1774
1775
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1776
class MergeIntoMerger(Merger):
1777
    """Merger that understands other_tree will be merged into a subdir.
1778
1779
    This also changes the Merger api so that it uses real Branch, revision_id,
1780
    and RevisonTree objects, rather than using revision specs.
1781
    """
1782
1783
    def __init__(self, this_tree, other_branch, other_tree, target_subdir,
5246.2.22 by Andrew Bennetts
Minor tweaks.
1784
            source_subpath, other_rev_id=None):
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1785
        """Create a new MergeIntoMerger object.
1786
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1787
        source_subpath in other_tree will be effectively copied to
1788
        target_subdir in this_tree.
1789
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1790
        :param this_tree: The tree that we will be merging into.
1791
        :param other_branch: The Branch we will be merging from.
1792
        :param other_tree: The RevisionTree object we want to merge.
1793
        :param target_subdir: The relative path where we want to merge
1794
            other_tree into this_tree
5246.2.6 by Andrew Bennetts
Improve some docstrings. Simplify code slightly.
1795
        :param source_subpath: The relative path specifying the subtree of
1796
            other_tree to merge into this_tree.
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1797
        """
1798
        # It is assumed that we are merging a tree that is not in our current
1799
        # ancestry, which means we are using the "EmptyTree" as our basis.
1800
        null_ancestor_tree = this_tree.branch.repository.revision_tree(
1801
                                _mod_revision.NULL_REVISION)
1802
        super(MergeIntoMerger, self).__init__(
1803
            this_branch=this_tree.branch,
1804
            this_tree=this_tree,
1805
            other_tree=other_tree,
1806
            base_tree=null_ancestor_tree,
1807
            )
1808
        self._target_subdir = target_subdir
1809
        self._source_subpath = source_subpath
1810
        self.other_branch = other_branch
5246.2.22 by Andrew Bennetts
Minor tweaks.
1811
        if other_rev_id is None:
1812
            other_rev_id = other_tree.get_revision_id()
1813
        self.other_rev_id = self.other_basis = other_rev_id
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1814
        self.base_is_ancestor = True
1815
        self.backup_files = True
1816
        self.merge_type = Merge3Merger
1817
        self.show_base = False
1818
        self.reprocess = False
1819
        self.interesting_ids = None
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1820
        self.merge_type = _MergeTypeParameterizer(MergeIntoMergeType,
1821
              target_subdir=self._target_subdir,
1822
              source_subpath=self._source_subpath)
5246.2.11 by Andrew Bennetts
Handle partial tree merges, add more tests, refactor tests a little.
1823
        if self._source_subpath != '':
1824
            # If this isn't a partial merge make sure the revisions will be
1825
            # present.
1826
            self._maybe_fetch(self.other_branch, self.this_branch,
1827
                self.other_basis)
1828
1829
    def set_pending(self):
1830
        if self._source_subpath != '':
1831
            return
1832
        Merger.set_pending(self)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1833
1834
5246.2.32 by Andrew Bennetts
Rename _Wrapper to _MergeTypeParameterizer.
1835
class _MergeTypeParameterizer(object):
5246.2.29 by Andrew Bennetts
Improve some docstrings.
1836
    """Wrap a merge-type class to provide extra parameters.
1837
    
1838
    This is hack used by MergeIntoMerger to pass some extra parameters to its
1839
    merge_type.  Merger.do_merge() sets up its own set of parameters to pass to
1840
    the 'merge_type' member.  It is difficult override do_merge without
1841
    re-writing the whole thing, so instead we create a wrapper which will pass
1842
    the extra parameters.
1843
    """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1844
1845
    def __init__(self, merge_type, **kwargs):
1846
        self._extra_kwargs = kwargs
1847
        self._merge_type = merge_type
1848
1849
    def __call__(self, *args, **kwargs):
1850
        kwargs.update(self._extra_kwargs)
1851
        return self._merge_type(*args, **kwargs)
1852
1853
    def __getattr__(self, name):
1854
        return getattr(self._merge_type, name)
1855
1856
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1857
class MergeIntoMergeType(Merge3Merger):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1858
    """Merger that incorporates a tree (or part of a tree) into another."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1859
1860
    def __init__(self, *args, **kwargs):
5246.2.28 by Andrew Bennetts
Improve some docstrings.
1861
        """Initialize the merger object.
1862
1863
        :param args: See Merge3Merger.__init__'s args.
1864
        :param kwargs: See Merge3Merger.__init__'s keyword args, except for
1865
            source_subpath and target_subdir.
1866
        :keyword source_subpath: The relative path specifying the subtree of
1867
            other_tree to merge into this_tree.
1868
        :keyword target_subdir: The relative path where we want to merge
1869
            other_tree into this_tree
1870
        """
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1871
        # All of the interesting work happens during Merge3Merger.__init__(),
1872
        # so we have have to hack in to get our extra parameters set.
1873
        self._source_subpath = kwargs.pop('source_subpath')
1874
        self._target_subdir = kwargs.pop('target_subdir')
5246.2.30 by Andrew Bennetts
Rename Merge3MergeIntoMerger to MergeIntoMergeType.
1875
        super(MergeIntoMergeType, self).__init__(*args, **kwargs)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1876
1877
    def _compute_transform(self):
1878
        child_pb = ui.ui_factory.nested_progress_bar()
1879
        try:
1880
            entries = self._entries_to_incorporate()
1881
            entries = list(entries)
1882
            for num, (entry, parent_id) in enumerate(entries):
1883
                child_pb.update('Preparing file merge', num, len(entries))
1884
                parent_trans_id = self.tt.trans_id_file_id(parent_id)
1885
                trans_id = transform.new_by_entry(self.tt, entry,
1886
                    parent_trans_id, self.other_tree)
1887
        finally:
1888
            child_pb.finished()
5246.2.33 by Andrew Bennetts
Rename _finish_transform to _finish_computing_transform.
1889
        self._finish_computing_transform()
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1890
1891
    def _entries_to_incorporate(self):
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1892
        """Yields pairs of (inventory_entry, new_parent)."""
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1893
        other_inv = self.other_tree.inventory
1894
        subdir_id = other_inv.path2id(self._source_subpath)
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1895
        if subdir_id is None:
5246.2.20 by Andrew Bennetts
Tweak comments, add NEWS entry.
1896
            # XXX: The error would be clearer if it gave the URL of the source
1897
            # branch, but we don't have a reference to that here.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1898
            raise PathNotInTree(self._source_subpath, "Source tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1899
        subdir = other_inv[subdir_id]
1900
        parent_in_target = osutils.dirname(self._target_subdir)
1901
        target_id = self.this_tree.inventory.path2id(parent_in_target)
1902
        if target_id is None:
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1903
            raise PathNotInTree(self._target_subdir, "Target tree")
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1904
        name_in_target = osutils.basename(self._target_subdir)
1905
        merge_into_root = subdir.copy()
1906
        merge_into_root.name = name_in_target
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1907
        if merge_into_root.file_id in self.this_tree.inventory:
5246.2.18 by Andrew Bennetts
Fix traceback if source path does not exist.
1908
            # Give the root a new file-id.
5246.2.23 by Andrew Bennetts
Fix XXX by adding a test for that case, and don't use AssertionError for a legitimate user error.
1909
            # This can happen fairly easily if the directory we are
1910
            # incorporating is the root, and both trees have 'TREE_ROOT' as
1911
            # their root_id.  Users will expect this to Just Work, so we
1912
            # change the file-id here.
1913
            # Non-root file-ids could potentially conflict too.  That's really
1914
            # an edge case, so we don't do anything special for those.  We let
1915
            # them cause conflicts.
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1916
            merge_into_root.file_id = generate_ids.gen_file_id(name_in_target)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1917
        yield (merge_into_root, target_id)
5246.2.10 by Andrew Bennetts
Add more tests.
1918
        if subdir.kind != 'directory':
1919
            # No children, so we are done.
1920
            return
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1921
        for ignored_path, entry in other_inv.iter_entries_by_dir(subdir_id):
5246.2.9 by Andrew Bennetts
Make all the existing tests pass.
1922
            parent_id = entry.parent_id
1923
            if parent_id == subdir.file_id:
1924
                # The root's parent ID has changed, so make sure children of
1925
                # the root refer to the new ID.
1926
                parent_id = merge_into_root.file_id
1927
            yield (entry, parent_id)
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1928
1929
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1930
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1931
                backup_files=False,
1932
                merge_type=Merge3Merger,
1933
                interesting_ids=None,
1934
                show_base=False,
1935
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1936
                other_rev_id=None,
1937
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
1938
                this_tree=None,
4961.2.9 by Martin Pool
Rip out most remaining uses of DummyProgressBar
1939
                pb=None,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1940
                change_reporter=None):
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
1941
    """Primary interface for merging.
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1942
5246.2.1 by Andrew Bennetts
Very rough first draft of cmd_merge_into from bzr-merge-into. Passes its blackbox tests.
1943
    Typical use is probably::
1944
1945
        merge_inner(branch, branch.get_revision_tree(other_revision),
1946
                    branch.get_revision_tree(base_revision))
1947
    """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1948
    if this_tree is None:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
1949
        raise errors.BzrError("bzrlib.merge.merge_inner requires a this_tree "
1950
                              "parameter as of bzrlib version 0.8.")
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1951
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1952
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1953
    merger.backup_files = backup_files
1954
    merger.merge_type = merge_type
1955
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1956
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1957
    if interesting_files:
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
1958
        if interesting_ids:
1959
            raise ValueError('Only supply interesting_ids'
1960
                             ' or interesting_files')
2590.2.5 by Aaron Bentley
Allow selected files to be specified instead of selected ids
1961
        merger.interesting_files = interesting_files
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1962
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1963
    merger.reprocess = reprocess
1964
    merger.other_rev_id = other_rev_id
1965
    merger.other_basis = other_rev_id
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1966
    get_revision_id = getattr(base_tree, 'get_revision_id', None)
1967
    if get_revision_id is None:
1968
        get_revision_id = base_tree.last_revision
4595.13.2 by Alexander Belchenko
[cherrypick revno 4650 from bzr.dev] Fix shelve on windows. (Robert Collins, #305006)
1969
    merger.cache_trees_with_revision_ids([other_tree, base_tree, this_tree])
3249.3.1 by John Arbash Meinel
Implement cherrypick support for Merge3
1970
    merger.set_base_revision(get_revision_id(), this_branch)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1971
    return merger.do_merge()
1972
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1973
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1974
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1975
1976
    This method provides a sanctioned way to retrieve it.
1977
    """
1978
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1979
    return option._merge_type_registry
1551.15.46 by Aaron Bentley
Move plan merge to tree
1980
1981
1982
def _plan_annotate_merge(annotated_a, annotated_b, ancestors_a, ancestors_b):
1983
    def status_a(revision, text):
1984
        if revision in ancestors_b:
1985
            return 'killed-b', text
1986
        else:
1987
            return 'new-a', text
1988
1989
    def status_b(revision, text):
1990
        if revision in ancestors_a:
1991
            return 'killed-a', text
1992
        else:
1993
            return 'new-b', text
1994
1995
    plain_a = [t for (a, t) in annotated_a]
1996
    plain_b = [t for (a, t) in annotated_b]
1997
    matcher = patiencediff.PatienceSequenceMatcher(None, plain_a, plain_b)
1998
    blocks = matcher.get_matching_blocks()
1999
    a_cur = 0
2000
    b_cur = 0
2001
    for ai, bi, l in blocks:
2002
        # process all mismatched sections
2003
        # (last mismatched section is handled because blocks always
2004
        # includes a 0-length last block)
2005
        for revision, text in annotated_a[a_cur:ai]:
2006
            yield status_a(revision, text)
2007
        for revision, text in annotated_b[b_cur:bi]:
2008
            yield status_b(revision, text)
2009
        # and now the matched section
2010
        a_cur = ai + l
2011
        b_cur = bi + l
3376.2.8 by Martin Pool
Some review cleanups for assertion removal
2012
        for text_a in plain_a[ai:a_cur]:
1551.15.46 by Aaron Bentley
Move plan merge to tree
2013
            yield "unchanged", text_a
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2014
2015
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2016
class _PlanMergeBase(object):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2017
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2018
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2019
        """Contructor.
2020
2021
        :param a_rev: Revision-id of one revision to merge
2022
        :param b_rev: Revision-id of the other revision to merge
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2023
        :param vf: A VersionedFiles containing both revisions
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2024
        :param key_prefix: A prefix for accessing keys in vf, typically
2025
            (file_id,).
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2026
        """
2027
        self.a_rev = a_rev
2028
        self.b_rev = b_rev
2029
        self.vf = vf
3062.1.12 by Aaron Bentley
Implement simple text cache
2030
        self._last_lines = None
2031
        self._last_lines_revision_id = None
3144.3.7 by Aaron Bentley
Update from review
2032
        self._cached_matching_blocks = {}
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2033
        self._key_prefix = key_prefix
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2034
        self._precache_tip_lines()
2035
2036
    def _precache_tip_lines(self):
2037
        lines = self.get_lines([self.a_rev, self.b_rev])
2038
        self.lines_a = lines[self.a_rev]
2039
        self.lines_b = lines[self.b_rev]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2040
2041
    def get_lines(self, revisions):
2042
        """Get lines for revisions from the backing VersionedFiles.
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2043
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2044
        :raises RevisionNotPresent: on absent texts.
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2045
        """
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2046
        keys = [(self._key_prefix + (rev,)) for rev in revisions]
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2047
        result = {}
2048
        for record in self.vf.get_record_stream(keys, 'unordered', True):
2049
            if record.storage_kind == 'absent':
2050
                raise errors.RevisionNotPresent(record.key, self.vf)
3890.2.9 by John Arbash Meinel
Start using osutils.chunks_as_lines rather than osutils.split_lines.
2051
            result[record.key[-1]] = osutils.chunks_to_lines(
2052
                record.get_bytes_as('chunked'))
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2053
        return result
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2054
2055
    def plan_merge(self):
2056
        """Generate a 'plan' for merging the two revisions.
2057
2058
        This involves comparing their texts and determining the cause of
2059
        differences.  If text A has a line and text B does not, then either the
2060
        line was added to text A, or it was deleted from B.  Once the causes
2061
        are combined, they are written out in the format described in
2062
        VersionedFile.plan_merge
2063
        """
2064
        blocks = self._get_matching_blocks(self.a_rev, self.b_rev)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2065
        unique_a, unique_b = self._unique_lines(blocks)
2066
        new_a, killed_b = self._determine_status(self.a_rev, unique_a)
2067
        new_b, killed_a = self._determine_status(self.b_rev, unique_b)
2068
        return self._iter_plan(blocks, new_a, killed_b, new_b, killed_a)
2069
2070
    def _iter_plan(self, blocks, new_a, killed_b, new_b, killed_a):
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2071
        last_i = 0
2072
        last_j = 0
2073
        for i, j, n in blocks:
2074
            for a_index in range(last_i, i):
2075
                if a_index in new_a:
3144.3.2 by Aaron Bentley
Get conflict handling working
2076
                    if a_index in killed_b:
2077
                        yield 'conflicted-a', self.lines_a[a_index]
2078
                    else:
2079
                        yield 'new-a', self.lines_a[a_index]
2080
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2081
                    yield 'killed-b', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2082
            for b_index in range(last_j, j):
2083
                if b_index in new_b:
3144.3.2 by Aaron Bentley
Get conflict handling working
2084
                    if b_index in killed_a:
3144.3.10 by Aaron Bentley
Use correct index when emitting conflicted-b
2085
                        yield 'conflicted-b', self.lines_b[b_index]
3144.3.2 by Aaron Bentley
Get conflict handling working
2086
                    else:
2087
                        yield 'new-b', self.lines_b[b_index]
2088
                else:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2089
                    yield 'killed-a', self.lines_b[b_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2090
            # handle common lines
2091
            for a_index in range(i, i+n):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2092
                yield 'unchanged', self.lines_a[a_index]
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2093
            last_i = i+n
2094
            last_j = j+n
2095
2096
    def _get_matching_blocks(self, left_revision, right_revision):
2097
        """Return a description of which sections of two revisions match.
2098
2099
        See SequenceMatcher.get_matching_blocks
2100
        """
3144.3.7 by Aaron Bentley
Update from review
2101
        cached = self._cached_matching_blocks.get((left_revision,
2102
                                                   right_revision))
2103
        if cached is not None:
2104
            return cached
3062.1.12 by Aaron Bentley
Implement simple text cache
2105
        if self._last_lines_revision_id == left_revision:
2106
            left_lines = self._last_lines
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2107
            right_lines = self.get_lines([right_revision])[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2108
        else:
3350.6.4 by Robert Collins
First cut at pluralised VersionedFiles. Some rather massive API incompatabilities, primarily because of the difficulty of coherence among competing stores.
2109
            lines = self.get_lines([left_revision, right_revision])
2110
            left_lines = lines[left_revision]
2111
            right_lines = lines[right_revision]
3062.1.12 by Aaron Bentley
Implement simple text cache
2112
        self._last_lines = right_lines
2113
        self._last_lines_revision_id = right_revision
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2114
        matcher = patiencediff.PatienceSequenceMatcher(None, left_lines,
2115
                                                       right_lines)
2116
        return matcher.get_matching_blocks()
2117
2118
    def _unique_lines(self, matching_blocks):
2119
        """Analyse matching_blocks to determine which lines are unique
2120
2121
        :return: a tuple of (unique_left, unique_right), where the values are
2122
            sets of line numbers of unique lines.
2123
        """
2124
        last_i = 0
2125
        last_j = 0
2126
        unique_left = []
2127
        unique_right = []
2128
        for i, j, n in matching_blocks:
2129
            unique_left.extend(range(last_i, i))
2130
            unique_right.extend(range(last_j, j))
2131
            last_i = i + n
2132
            last_j = j + n
2133
        return unique_left, unique_right
2134
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2135
    @staticmethod
2136
    def _subtract_plans(old_plan, new_plan):
3144.3.7 by Aaron Bentley
Update from review
2137
        """Remove changes from new_plan that came from old_plan.
2138
2139
        It is assumed that the difference between the old_plan and new_plan
2140
        is their choice of 'b' text.
2141
2142
        All lines from new_plan that differ from old_plan are emitted
2143
        verbatim.  All lines from new_plan that match old_plan but are
2144
        not about the 'b' revision are emitted verbatim.
2145
2146
        Lines that match and are about the 'b' revision are the lines we
2147
        don't want, so we convert 'killed-b' -> 'unchanged', and 'new-b'
2148
        is skipped entirely.
2149
        """
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2150
        matcher = patiencediff.PatienceSequenceMatcher(None, old_plan,
2151
                                                       new_plan)
2152
        last_j = 0
2153
        for i, j, n in matcher.get_matching_blocks():
2154
            for jj in range(last_j, j):
2155
                yield new_plan[jj]
2156
            for jj in range(j, j+n):
2157
                plan_line = new_plan[jj]
2158
                if plan_line[0] == 'new-b':
2159
                    pass
2160
                elif plan_line[0] == 'killed-b':
2161
                    yield 'unchanged', plan_line[1]
2162
                else:
2163
                    yield plan_line
2164
            last_j = j + n
2165
2166
2167
class _PlanMerge(_PlanMergeBase):
2168
    """Plan an annotate merge using on-the-fly annotation"""
2169
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2170
    def __init__(self, a_rev, b_rev, vf, key_prefix):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2171
        super(_PlanMerge, self).__init__(a_rev, b_rev, vf, key_prefix)
2172
        self.a_key = self._key_prefix + (self.a_rev,)
2173
        self.b_key = self._key_prefix + (self.b_rev,)
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2174
        self.graph = _mod_graph.Graph(self.vf)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2175
        heads = self.graph.heads((self.a_key, self.b_key))
2176
        if len(heads) == 1:
2177
            # one side dominates, so we can just return its values, yay for
2178
            # per-file graphs
2179
            # Ideally we would know that before we get this far
2180
            self._head_key = heads.pop()
2181
            if self._head_key == self.a_key:
2182
                other = b_rev
2183
            else:
2184
                other = a_rev
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2185
            trace.mutter('found dominating revision for %s\n%s > %s', self.vf,
2186
                         self._head_key[-1], other)
3514.2.11 by John Arbash Meinel
Shortcut the case when one revision is in the ancestry of the other.
2187
            self._weave = None
2188
        else:
2189
            self._head_key = None
2190
            self._build_weave()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2191
2192
    def _precache_tip_lines(self):
2193
        # Turn this into a no-op, because we will do this later
2194
        pass
2195
2196
    def _find_recursive_lcas(self):
2197
        """Find all the ancestors back to a unique lca"""
2198
        cur_ancestors = (self.a_key, self.b_key)
2199
        # graph.find_lca(uncommon, keys) now returns plain NULL_REVISION,
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2200
        # rather than a key tuple. We will just map that directly to no common
2201
        # ancestors.
2202
        parent_map = {}
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2203
        while True:
2204
            next_lcas = self.graph.find_lca(*cur_ancestors)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2205
            # Map a plain NULL_REVISION to a simple no-ancestors
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2206
            if next_lcas == set([_mod_revision.NULL_REVISION]):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2207
                next_lcas = ()
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2208
            # Order the lca's based on when they were merged into the tip
2209
            # While the actual merge portion of weave merge uses a set() of
2210
            # active revisions, the order of insertion *does* effect the
2211
            # implicit ordering of the texts.
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2212
            for rev_key in cur_ancestors:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2213
                ordered_parents = tuple(self.graph.find_merge_order(rev_key,
2214
                                                                    next_lcas))
2215
                parent_map[rev_key] = ordered_parents
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2216
            if len(next_lcas) == 0:
2217
                break
2218
            elif len(next_lcas) == 1:
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2219
                parent_map[list(next_lcas)[0]] = ()
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2220
                break
3514.2.10 by John Arbash Meinel
Handle more edge cases.
2221
            elif len(next_lcas) > 2:
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2222
                # More than 2 lca's, fall back to grabbing all nodes between
2223
                # this and the unique lca.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2224
                trace.mutter('More than 2 LCAs, falling back to all nodes for:'
2225
                             ' %s, %s\n=> %s',
2226
                             self.a_key, self.b_key, cur_ancestors)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2227
                cur_lcas = next_lcas
2228
                while len(cur_lcas) > 1:
2229
                    cur_lcas = self.graph.find_lca(*cur_lcas)
2230
                if len(cur_lcas) == 0:
2231
                    # No common base to find, use the full ancestry
2232
                    unique_lca = None
2233
                else:
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2234
                    unique_lca = list(cur_lcas)[0]
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2235
                    if unique_lca == _mod_revision.NULL_REVISION:
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2236
                        # find_lca will return a plain 'NULL_REVISION' rather
2237
                        # than a key tuple when there is no common ancestor, we
2238
                        # prefer to just use None, because it doesn't confuse
2239
                        # _get_interesting_texts()
2240
                        unique_lca = None
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2241
                parent_map.update(self._find_unique_parents(next_lcas,
2242
                                                            unique_lca))
2243
                break
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2244
            cur_ancestors = next_lcas
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2245
        return parent_map
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2246
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2247
    def _find_unique_parents(self, tip_keys, base_key):
2248
        """Find ancestors of tip that aren't ancestors of base.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2249
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2250
        :param tip_keys: Nodes that are interesting
2251
        :param base_key: Cull all ancestors of this node
2252
        :return: The parent map for all revisions between tip_keys and
2253
            base_key. base_key will be included. References to nodes outside of
2254
            the ancestor set will also be removed.
2255
        """
2256
        # TODO: this would be simpler if find_unique_ancestors took a list
2257
        #       instead of a single tip, internally it supports it, but it
2258
        #       isn't a "backwards compatible" api change.
2259
        if base_key is None:
2260
            parent_map = dict(self.graph.iter_ancestry(tip_keys))
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2261
            # We remove NULL_REVISION because it isn't a proper tuple key, and
2262
            # thus confuses things like _get_interesting_texts, and our logic
2263
            # to add the texts into the memory weave.
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2264
            if _mod_revision.NULL_REVISION in parent_map:
2265
                parent_map.pop(_mod_revision.NULL_REVISION)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2266
        else:
2267
            interesting = set()
2268
            for tip in tip_keys:
2269
                interesting.update(
2270
                    self.graph.find_unique_ancestors(tip, [base_key]))
2271
            parent_map = self.graph.get_parent_map(interesting)
2272
            parent_map[base_key] = ()
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2273
        culled_parent_map, child_map, tails = self._remove_external_references(
2274
            parent_map)
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2275
        # Remove all the tails but base_key
3514.2.14 by John Arbash Meinel
Bring in the code to collapse linear portions of the graph.
2276
        if base_key is not None:
2277
            tails.remove(base_key)
2278
            self._prune_tails(culled_parent_map, child_map, tails)
2279
        # Now remove all the uninteresting 'linear' regions
3514.2.15 by John Arbash Meinel
Enable collapsing linear regions.
2280
        simple_map = _mod_graph.collapse_linear_regions(culled_parent_map)
2281
        return simple_map
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2282
2283
    @staticmethod
2284
    def _remove_external_references(parent_map):
2285
        """Remove references that go outside of the parent map.
2286
2287
        :param parent_map: Something returned from Graph.get_parent_map(keys)
2288
        :return: (filtered_parent_map, child_map, tails)
2289
            filtered_parent_map is parent_map without external references
2290
            child_map is the {parent_key: [child_keys]} mapping
2291
            tails is a list of nodes that do not have any parents in the map
2292
        """
2293
        # TODO: The basic effect of this function seems more generic than
2294
        #       _PlanMerge. But the specific details of building a child_map,
2295
        #       and computing tails seems very specific to _PlanMerge.
2296
        #       Still, should this be in Graph land?
2297
        filtered_parent_map = {}
2298
        child_map = {}
2299
        tails = []
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2300
        for key, parent_keys in parent_map.iteritems():
3514.2.12 by John Arbash Meinel
Start refactoring into helper functions
2301
            culled_parent_keys = [p for p in parent_keys if p in parent_map]
2302
            if not culled_parent_keys:
2303
                tails.append(key)
2304
            for parent_key in culled_parent_keys:
2305
                child_map.setdefault(parent_key, []).append(key)
2306
            # TODO: Do we want to do this, it adds overhead for every node,
2307
            #       just to say that the node has no children
2308
            child_map.setdefault(key, [])
2309
            filtered_parent_map[key] = culled_parent_keys
2310
        return filtered_parent_map, child_map, tails
2311
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2312
    @staticmethod
2313
    def _prune_tails(parent_map, child_map, tails_to_remove):
2314
        """Remove tails from the parent map.
3943.8.1 by Marius Kruger
remove all trailing whitespace from bzr source
2315
3514.2.13 by John Arbash Meinel
Add the ability to prune extra tails from the parent_map.
2316
        This will remove the supplied revisions until no more children have 0
2317
        parents.
2318
2319
        :param parent_map: A dict of {child: [parents]}, this dictionary will
2320
            be modified in place.
2321
        :param tails_to_remove: A list of tips that should be removed,
2322
            this list will be consumed
2323
        :param child_map: The reverse dict of parent_map ({parent: [children]})
2324
            this dict will be modified
2325
        :return: None, parent_map will be modified in place.
2326
        """
2327
        while tails_to_remove:
2328
            next = tails_to_remove.pop()
2329
            parent_map.pop(next)
2330
            children = child_map.pop(next)
2331
            for child in children:
2332
                child_parents = parent_map[child]
2333
                child_parents.remove(next)
2334
                if len(child_parents) == 0:
2335
                    tails_to_remove.append(child)
3514.2.7 by John Arbash Meinel
Fix the failing test by implementing the fallback logic.
2336
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2337
    def _get_interesting_texts(self, parent_map):
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2338
        """Return a dict of texts we are interested in.
2339
2340
        Note that the input is in key tuples, but the output is in plain
2341
        revision ids.
2342
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2343
        :param parent_map: The output from _find_recursive_lcas
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2344
        :return: A dict of {'revision_id':lines} as returned by
2345
            _PlanMergeBase.get_lines()
2346
        """
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2347
        all_revision_keys = set(parent_map)
2348
        all_revision_keys.add(self.a_key)
2349
        all_revision_keys.add(self.b_key)
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2350
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2351
        # Everything else is in 'keys' but get_lines is in 'revision_ids'
2352
        all_texts = self.get_lines([k[-1] for k in all_revision_keys])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2353
        return all_texts
2354
2355
    def _build_weave(self):
2356
        from bzrlib import weave
2357
        self._weave = weave.Weave(weave_name='in_memory_weave',
2358
                                  allow_reserved=True)
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2359
        parent_map = self._find_recursive_lcas()
2360
2361
        all_texts = self._get_interesting_texts(parent_map)
2362
2363
        # Note: Unfortunately, the order given by topo_sort will effect the
2364
        # ordering resolution in the output. Specifically, if you add A then B,
2365
        # then in the output text A lines will show up before B lines. And, of
2366
        # course, topo_sort doesn't guarantee any real ordering.
3514.2.8 by John Arbash Meinel
The insertion ordering into the weave has an impact on conflicts.
2367
        # So we use merge_sort, and add a fake node on the tip.
2368
        # This ensures that left-hand parents will always be inserted into the
2369
        # weave before right-hand parents.
2370
        tip_key = self._key_prefix + (_mod_revision.CURRENT_REVISION,)
2371
        parent_map[tip_key] = (self.a_key, self.b_key)
2372
2373
        for seq_num, key, depth, eom in reversed(tsort.merge_sort(parent_map,
2374
                                                                  tip_key)):
2375
            if key == tip_key:
2376
                continue
3514.2.9 by John Arbash Meinel
Add some debugging, and work on getting the graph right so we get the weave insertion order correct.
2377
        # for key in tsort.topo_sort(parent_map):
3514.2.5 by John Arbash Meinel
Switch to the get_parent_map design I had settled on.
2378
            parent_keys = parent_map[key]
2379
            revision_id = key[-1]
2380
            parent_ids = [k[-1] for k in parent_keys]
2381
            self._weave.add_lines(revision_id, parent_ids,
2382
                                  all_texts[revision_id])
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2383
2384
    def plan_merge(self):
2385
        """Generate a 'plan' for merging the two revisions.
2386
2387
        This involves comparing their texts and determining the cause of
2388
        differences.  If text A has a line and text B does not, then either the
2389
        line was added to text A, or it was deleted from B.  Once the causes
2390
        are combined, they are written out in the format described in
2391
        VersionedFile.plan_merge
2392
        """
2393
        if self._head_key is not None: # There was a single head
2394
            if self._head_key == self.a_key:
2395
                plan = 'new-a'
3062.1.9 by Aaron Bentley
Move PlanMerge into merge and _PlanMergeVersionedFile into versionedfile
2396
            else:
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2397
                if self._head_key != self.b_key:
2398
                    raise AssertionError('There was an invalid head: %s != %s'
2399
                                         % (self.b_key, self._head_key))
2400
                plan = 'new-b'
3514.2.16 by John Arbash Meinel
Review feedback from Ian.
2401
            head_rev = self._head_key[-1]
2402
            lines = self.get_lines([head_rev])[head_rev]
3514.2.2 by John Arbash Meinel
Restore a real weave merge to 'bzr merge --weave'.
2403
            return ((plan, line) for line in lines)
2404
        return self._weave.plan_merge(self.a_rev, self.b_rev)
3062.2.1 by Aaron Bentley
Add support for plan-merge with a base
2405
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2406
2407
class _PlanLCAMerge(_PlanMergeBase):
2408
    """
3144.3.7 by Aaron Bentley
Update from review
2409
    This merge algorithm differs from _PlanMerge in that:
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2410
    1. comparisons are done against LCAs only
2411
    2. cases where a contested line is new versus one LCA but old versus
3144.3.7 by Aaron Bentley
Update from review
2412
       another are marked as conflicts, by emitting the line as conflicted-a
2413
       or conflicted-b.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2414
2415
    This is faster, and hopefully produces more useful output.
2416
    """
2417
3350.6.10 by Martin Pool
VersionedFiles review cleanups
2418
    def __init__(self, a_rev, b_rev, vf, key_prefix, graph):
2419
        _PlanMergeBase.__init__(self, a_rev, b_rev, vf, key_prefix)
2420
        lcas = graph.find_lca(key_prefix + (a_rev,), key_prefix + (b_rev,))
3350.6.5 by Robert Collins
Update to bzr.dev.
2421
        self.lcas = set()
2422
        for lca in lcas:
4721.3.1 by Vincent Ladeuil
Cleanup imports.
2423
            if lca == _mod_revision.NULL_REVISION:
3350.6.5 by Robert Collins
Update to bzr.dev.
2424
                self.lcas.add(lca)
2425
            else:
2426
                self.lcas.add(lca[-1])
3144.3.7 by Aaron Bentley
Update from review
2427
        for lca in self.lcas:
3287.17.1 by John Arbash Meinel
Fix bug #235715 by using the empty list as the text for a base of NULL_REVISION.
2428
            if _mod_revision.is_null(lca):
2429
                lca_lines = []
2430
            else:
3350.6.5 by Robert Collins
Update to bzr.dev.
2431
                lca_lines = self.get_lines([lca])[lca]
3144.3.7 by Aaron Bentley
Update from review
2432
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_a,
2433
                                                           lca_lines)
2434
            blocks = list(matcher.get_matching_blocks())
2435
            self._cached_matching_blocks[(a_rev, lca)] = blocks
2436
            matcher = patiencediff.PatienceSequenceMatcher(None, self.lines_b,
2437
                                                           lca_lines)
2438
            blocks = list(matcher.get_matching_blocks())
2439
            self._cached_matching_blocks[(b_rev, lca)] = blocks
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2440
3144.3.7 by Aaron Bentley
Update from review
2441
    def _determine_status(self, revision_id, unique_line_numbers):
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2442
        """Determines the status unique lines versus all lcas.
2443
2444
        Basically, determines why the line is unique to this revision.
2445
2446
        A line may be determined new, killed, or both.
2447
3144.3.7 by Aaron Bentley
Update from review
2448
        If a line is determined new, that means it was not present in at least
2449
        one LCA, and is not present in the other merge revision.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2450
2451
        If a line is determined killed, that means the line was present in
2452
        at least one LCA.
2453
2454
        If a line is killed and new, this indicates that the two merge
2455
        revisions contain differing conflict resolutions.
3144.3.7 by Aaron Bentley
Update from review
2456
        :param revision_id: The id of the revision in which the lines are
2457
            unique
2458
        :param unique_line_numbers: The line numbers of unique lines.
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2459
        :return a tuple of (new_this, killed_other):
2460
        """
2461
        new = set()
2462
        killed = set()
3144.3.7 by Aaron Bentley
Update from review
2463
        unique_line_numbers = set(unique_line_numbers)
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2464
        for lca in self.lcas:
2465
            blocks = self._get_matching_blocks(revision_id, lca)
2466
            unique_vs_lca, _ignored = self._unique_lines(blocks)
3144.3.7 by Aaron Bentley
Update from review
2467
            new.update(unique_line_numbers.intersection(unique_vs_lca))
2468
            killed.update(unique_line_numbers.difference(unique_vs_lca))
3144.3.1 by Aaron Bentley
Implement LCA merge, with problematic conflict markers
2469
        return new, killed