/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
1692.7.6 by Martin Pool
[patch] force deletion of trees containing readonly files (alexander)
1
# Copyright (C) 2005, 2006 Canonical Ltd
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
2
#
1110 by Martin Pool
- merge aaron's merge improvements:
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
7
#
1110 by Martin Pool
- merge aaron's merge improvements:
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
12
#
1110 by Martin Pool
- merge aaron's merge improvements:
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
17
1185.1.2 by Martin Pool
- merge various windows and other fixes from Ollie Rutherfurd
18
import os
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
19
import errno
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
20
import warnings
1113 by Martin Pool
- fix is_ancestor import problem in merge
21
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
22
from bzrlib import (
23
    osutils,
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
24
    registry,
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
25
    )
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
26
from bzrlib.branch import Branch
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
27
from bzrlib.conflicts import ConflictList, Conflict
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
28
from bzrlib.errors import (BzrCommandError,
1534.4.28 by Robert Collins
first cut at merge from integration.
29
                           BzrError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
30
                           NoCommonAncestor,
31
                           NoCommits,
1534.4.28 by Robert Collins
first cut at merge from integration.
32
                           NoSuchRevision,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
33
                           NoSuchFile,
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
34
                           NotBranchError,
1185.33.27 by Martin Pool
[merge] much integrated work from robert and john
35
                           NotVersionedError,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
36
                           UnrelatedBranches,
1534.10.12 by Aaron Bentley
Merge produces new conflicts
37
                           UnsupportedOperation,
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
38
                           WorkingTreeNotRevision,
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
39
                           BinaryFile,
1534.4.28 by Robert Collins
first cut at merge from integration.
40
                           )
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
41
from bzrlib.merge3 import Merge3
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
42
from bzrlib.osutils import rename, pathjoin
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
43
from progress import DummyProgress, ProgressPhase
1534.4.28 by Robert Collins
first cut at merge from integration.
44
from bzrlib.revision import common_ancestor, is_ancestor, NULL_REVISION
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
45
from bzrlib.textfile import check_text_lines
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
46
from bzrlib.trace import mutter, warning, note
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
47
from bzrlib.transform import (TreeTransform, resolve_conflicts, cook_conflicts,
1731.1.33 by Aaron Bentley
Revert no-special-root changes
48
                              FinalPaths, create_by_entry, unique_add,
49
                              ROOT_PARENT)
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
50
from bzrlib.versionedfile import WeaveMerge
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
51
from bzrlib import ui
1545.2.6 by Aaron Bentley
Removed _merge, renamed MergeConflictHandler to _MergeConflictHandler
52
53
# TODO: Report back as changes are merged in
54
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
55
def _get_tree(treespec, local_branch=None):
1910.1.1 by Aaron Bentley
Merge takes --uncommitted parameter
56
    from bzrlib import workingtree
622 by Martin Pool
Updated merge patch from Aaron
57
    location, revno = treespec
1910.1.1 by Aaron Bentley
Merge takes --uncommitted parameter
58
    if revno is None:
59
        tree = workingtree.WorkingTree.open_containing(location)[0]
60
        return tree.branch, tree
1442.1.64 by Robert Collins
Branch.open_containing now returns a tuple (Branch, relative-path).
61
    branch = Branch.open_containing(location)[0]
1910.1.1 by Aaron Bentley
Merge takes --uncommitted parameter
62
    if revno == -1:
1241 by Martin Pool
- rename last_patch to last_revision
63
        revision = branch.last_revision()
974.1.36 by aaron.bentley at utoronto
Committed it even though the test case doesn't work
64
    else:
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
65
        revision = branch.get_rev_id(revno)
1185.12.98 by Aaron Bentley
Support for forcing merges of unrelated trees
66
        if revision is None:
67
            revision = NULL_REVISION
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
68
    return branch, _get_revid_tree(branch, revision, local_branch)
974.1.36 by aaron.bentley at utoronto
Committed it even though the test case doesn't work
69
1545.2.4 by Aaron Bentley
PEP8 fixes
70
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
71
def _get_revid_tree(branch, revision, local_branch):
974.1.36 by aaron.bentley at utoronto
Committed it even though the test case doesn't work
72
    if revision is None:
1534.4.50 by Robert Collins
Got the bzrdir api straightened out, plenty of refactoring to use it pending, but the api is up and running.
73
        base_tree = branch.bzrdir.open_workingtree()
493 by Martin Pool
- Merge aaron's merge command
74
    else:
974.1.32 by aaron.bentley at utoronto
Made merge do greedy fetching.
75
        if local_branch is not None:
1185.65.30 by Robert Collins
Merge integration.
76
            if local_branch.base != branch.base:
1534.1.31 by Robert Collins
Deprecated fetch.fetch and fetch.greedy_fetch for branch.fetch, and move the Repository.fetch internals to InterRepo and InterWeaveRepo.
77
                local_branch.fetch(branch, revision)
1185.67.2 by Aaron Bentley
Renamed Branch.storage to Branch.repository
78
            base_tree = local_branch.repository.revision_tree(revision)
974.1.32 by aaron.bentley at utoronto
Made merge do greedy fetching.
79
        else:
1185.67.2 by Aaron Bentley
Renamed Branch.storage to Branch.repository
80
            base_tree = branch.repository.revision_tree(revision)
1185.12.41 by abentley
Got rid of MergeAdapterTree
81
    return base_tree
493 by Martin Pool
- Merge aaron's merge command
82
83
1185.35.4 by Aaron Bentley
Implemented remerge
84
def transform_tree(from_tree, to_tree, interesting_ids=None):
85
    merge_inner(from_tree.branch, to_tree, from_tree, ignore_zero=True,
1558.1.3 by Aaron Bentley
Fixed deprecated op use in test suite
86
                interesting_ids=interesting_ids, this_tree=from_tree)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
87
1457.1.12 by Robert Collins
Update comment to reflect author.
88
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
89
class Merger(object):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
90
    def __init__(self, this_branch, other_tree=None, base_tree=None,
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
91
                 this_tree=None, pb=DummyProgress(), change_reporter=None,
92
                 recurse='down'):
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
93
        object.__init__(self)
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
94
        assert this_tree is not None, "this_tree is required"
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
95
        self.this_branch = this_branch
96
        self.this_basis = this_branch.last_revision()
97
        self.this_rev_id = None
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
98
        self.this_tree = this_tree
1185.12.83 by Aaron Bentley
Preliminary weave merge support
99
        self.this_revision_tree = None
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
100
        self.this_basis_tree = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
101
        self.other_tree = other_tree
2100.3.29 by Aaron Bentley
Get merge working initially
102
        self.other_branch = None
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
103
        self.base_tree = base_tree
104
        self.ignore_zero = False
105
        self.backup_files = False
106
        self.interesting_ids = None
107
        self.show_base = False
1185.24.3 by Aaron Bentley
Integrated reprocessing into the rest of the merge stuff
108
        self.reprocess = False
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
109
        self._pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
110
        self.pp = None
2100.3.29 by Aaron Bentley
Get merge working initially
111
        self.recurse = recurse
1551.11.9 by Aaron Bentley
Apply change reporting to merge
112
        self.change_reporter = change_reporter
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
113
1185.12.83 by Aaron Bentley
Preliminary weave merge support
114
    def revision_tree(self, revision_id):
1185.67.2 by Aaron Bentley
Renamed Branch.storage to Branch.repository
115
        return self.this_branch.repository.revision_tree(revision_id)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
116
117
    def ensure_revision_trees(self):
118
        if self.this_revision_tree is None:
1185.67.2 by Aaron Bentley
Renamed Branch.storage to Branch.repository
119
            self.this_basis_tree = self.this_branch.repository.revision_tree(
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
120
                self.this_basis)
121
            if self.this_basis == self.this_rev_id:
122
                self.this_revision_tree = self.this_basis_tree
123
1185.12.83 by Aaron Bentley
Preliminary weave merge support
124
        if self.other_rev_id is None:
125
            other_basis_tree = self.revision_tree(self.other_basis)
1852.10.3 by Robert Collins
Remove all uses of compare_trees and replace with Tree.changes_from throughout bzrlib.
126
            changes = other_basis_tree.changes_from(self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
127
            if changes.has_changed():
128
                raise WorkingTreeNotRevision(self.this_tree)
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
129
            other_rev_id = self.other_basis
1185.12.83 by Aaron Bentley
Preliminary weave merge support
130
            self.other_tree = other_basis_tree
131
132
    def file_revisions(self, file_id):
133
        self.ensure_revision_trees()
134
        def get_id(tree, file_id):
135
            revision_id = tree.inventory[file_id].revision
136
            assert revision_id is not None
137
            return revision_id
1185.35.5 by Aaron Bentley
Made weave merge succeed if interesting files match history
138
        if self.this_rev_id is None:
139
            if self.this_basis_tree.get_file_sha1(file_id) != \
140
                self.this_tree.get_file_sha1(file_id):
141
                raise WorkingTreeNotRevision(self.this_tree)
142
143
        trees = (self.this_basis_tree, self.other_tree)
1185.12.83 by Aaron Bentley
Preliminary weave merge support
144
        return [get_id(tree, file_id) for tree in trees]
145
1185.82.44 by Aaron Bentley
Switch to merge_changeset in test suite
146
    def check_basis(self, check_clean, require_commits=True):
147
        if self.this_basis is None and require_commits is True:
2249.3.1 by John Arbash Meinel
Mention using 'bzr pull' if there are no commits in current branch
148
            raise BzrCommandError("This branch has no commits."
149
                                  " (perhaps you would prefer 'bzr pull')")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
150
        if check_clean:
151
            self.compare_basis()
152
            if self.this_basis != self.this_rev_id:
153
                raise BzrCommandError("Working tree has uncommitted changes.")
154
155
    def compare_basis(self):
1852.10.3 by Robert Collins
Remove all uses of compare_trees and replace with Tree.changes_from throughout bzrlib.
156
        changes = self.this_tree.changes_from(self.this_tree.basis_tree())
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
157
        if not changes.has_changed():
158
            self.this_rev_id = self.this_basis
159
160
    def set_interesting_files(self, file_list):
1457.1.8 by Robert Collins
Replace the WorkingTree.revert method algorithm with a call to merge_inner.
161
        try:
162
            self._set_interesting_files(file_list)
163
        except NotVersionedError, e:
164
            raise BzrCommandError("%s is not a source file in any"
165
                                      " tree." % e.path)
166
167
    def _set_interesting_files(self, file_list):
168
        """Set the list of interesting ids from a list of files."""
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
169
        if file_list is None:
170
            self.interesting_ids = None
171
            return
172
1465 by Robert Collins
Bugfix the new pull --clobber to not generate spurious conflicts.
173
        interesting_ids = set()
1185.50.53 by John Arbash Meinel
[patch] Aaron Bentley: make revert work in a subdirectory.
174
        for path in file_list:
1465 by Robert Collins
Bugfix the new pull --clobber to not generate spurious conflicts.
175
            found_id = False
2255.7.12 by John Arbash Meinel
Some comments on merge code, fix merge tests that
176
            # TODO: jam 20070226 The trees are not locked at this time,
177
            #       wouldn't it make merge faster if it locks everything in the
178
            #       beginning? It locks at do_merge time, but this happens
179
            #       before that.
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
180
            for tree in (self.this_tree, self.base_tree, self.other_tree):
2255.7.11 by John Arbash Meinel
Avoid directly accessing tree.inventory in merge.py
181
                file_id = tree.path2id(path)
1465 by Robert Collins
Bugfix the new pull --clobber to not generate spurious conflicts.
182
                if file_id is not None:
183
                    interesting_ids.add(file_id)
184
                    found_id = True
185
            if not found_id:
1185.50.53 by John Arbash Meinel
[patch] Aaron Bentley: make revert work in a subdirectory.
186
                raise NotVersionedError(path=path)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
187
        self.interesting_ids = interesting_ids
188
189
    def set_pending(self):
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
190
        if not self.base_is_ancestor:
191
            return
192
        if self.other_rev_id is None:
193
            return
1185.67.2 by Aaron Bentley
Renamed Branch.storage to Branch.repository
194
        ancestry = self.this_branch.repository.get_ancestry(self.this_basis)
1185.66.2 by Aaron Bentley
Moved get_ancestry to RevisionStorage
195
        if self.other_rev_id in ancestry:
1185.12.77 by Aaron Bentley
Prevented all ancestors from being marked as pending merges
196
            return
1908.6.3 by Robert Collins
Tidy up the last_revision_id and add_pending_merge conversion to use cleaner apis.
197
        self.this_tree.add_parent_tree((self.other_rev_id, self.other_tree))
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
198
199
    def set_other(self, other_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
200
        """Set the revision and tree to merge from.
201
202
        This sets the other_tree, other_rev_id, other_basis attributes.
203
204
        :param other_revision: The [path, revision] list to merge from.
205
        """
2100.3.29 by Aaron Bentley
Get merge working initially
206
        self.other_branch, self.other_tree = _get_tree(other_revision,
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
207
                                                  self.this_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
208
        if other_revision[1] == -1:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
209
            self.other_rev_id = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
210
            if self.other_rev_id is None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
211
                raise NoCommits(self.other_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
212
            self.other_basis = self.other_rev_id
213
        elif other_revision[1] is not None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
214
            self.other_rev_id = self.other_branch.get_rev_id(other_revision[1])
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
215
            self.other_basis = self.other_rev_id
216
        else:
217
            self.other_rev_id = None
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
218
            self.other_basis = self.other_branch.last_revision()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
219
            if self.other_basis is None:
2100.3.31 by Aaron Bentley
Merged bzr.dev (17 tests failing)
220
                raise NoCommits(self.other_branch)
221
        if self.other_branch.base != self.this_branch.base:
222
            self.this_branch.fetch(self.other_branch,
223
                                   last_revision=self.other_basis)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
224
2100.3.29 by Aaron Bentley
Get merge working initially
225
    def set_other_revision(self, revision_id, other_branch):
226
        """Set 'other' based on a branch and revision id
227
228
        :param revision_id: The revision to use for a tree
229
        :param other_branch: The branch containing this tree
230
        """
231
        self.other_rev_id = revision_id
232
        self.other_branch = other_branch
233
        self.this_branch.fetch(other_branch, self.other_rev_id)
234
        self.other_tree = self.revision_tree(revision_id)
235
        self.other_basis = revision_id
236
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
237
    def find_base(self):
1185.82.29 by Aaron Bentley
Got merge test working
238
        self.set_base([None, None])
1185.82.25 by Aaron Bentley
Added changeset-merging functionality
239
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
240
    def set_base(self, base_revision):
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
241
        """Set the base revision to use for the merge.
242
243
        :param base_revision: A 2-list containing a path and revision number.
244
        """
1185.12.96 by Aaron Bentley
Merge from mpool
245
        mutter("doing merge() with no base_revision specified")
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
246
        if base_revision == [None, None]:
247
            try:
2094.3.5 by John Arbash Meinel
Fix imports to ensure modules are loaded before they are used
248
                pb = ui.ui_factory.nested_progress_bar()
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
249
                try:
250
                    this_repo = self.this_branch.repository
251
                    self.base_rev_id = common_ancestor(self.this_basis, 
252
                                                       self.other_basis, 
253
                                                       this_repo, pb)
254
                finally:
255
                    pb.finished()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
256
            except NoCommonAncestor:
257
                raise UnrelatedBranches()
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
258
            self.base_tree = _get_revid_tree(self.this_branch, self.base_rev_id,
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
259
                                            None)
260
            self.base_is_ancestor = True
261
        else:
1545.2.3 by Aaron Bentley
Updated following j-a-meinel's comments
262
            base_branch, self.base_tree = _get_tree(base_revision)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
263
            if base_revision[1] == -1:
264
                self.base_rev_id = base_branch.last_revision()
265
            elif base_revision[1] is None:
266
                self.base_rev_id = None
493 by Martin Pool
- Merge aaron's merge command
267
            else:
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
268
                self.base_rev_id = base_branch.get_rev_id(base_revision[1])
1558.4.11 by Aaron Bentley
Allow merge against self, make fetching self a noop
269
            if self.this_branch.base != base_branch.base:
270
                self.this_branch.fetch(base_branch)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
271
            self.base_is_ancestor = is_ancestor(self.this_basis, 
272
                                                self.base_rev_id,
273
                                                self.this_branch)
274
275
    def do_merge(self):
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
276
        kwargs = {'working_tree':self.this_tree, 'this_tree': self.this_tree,
277
                  'other_tree': self.other_tree,
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
278
                  'interesting_ids': self.interesting_ids,
279
                  'pp': self.pp}
1534.7.84 by Aaron Bentley
Added reprocess support, support for varying merge types
280
        if self.merge_type.requires_base:
281
            kwargs['base_tree'] = self.base_tree
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
282
        if self.merge_type.supports_reprocess:
283
            kwargs['reprocess'] = self.reprocess
284
        elif self.reprocess:
1551.6.14 by Aaron Bentley
Tweaks from merge review
285
            raise BzrError("Conflict reduction is not supported for merge"
286
                                  " type %s." % self.merge_type)
1534.7.137 by Aaron Bentley
Avoided generating a new tree for every weave merge
287
        if self.merge_type.supports_show_base:
288
            kwargs['show_base'] = self.show_base
289
        elif self.show_base:
1534.8.2 by Aaron Bentley
Implemented weave merge
290
            raise BzrError("Showing base is not supported for this"
291
                                  " merge type. %s" % self.merge_type)
2255.2.50 by John Arbash Meinel
merge only needs a lock_tree_write() on the working tree, not a full lock_write()
292
        self.this_tree.lock_tree_write()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
293
        if self.base_tree is not None:
294
            self.base_tree.lock_read()
295
        if self.other_tree is not None:
296
            self.other_tree.lock_read()
297
        try:
2255.2.83 by John Arbash Meinel
[merge] bzr.dev 2294
298
            merge = self.merge_type(pb=self._pb,
299
                                    change_reporter=self.change_reporter,
300
                                    **kwargs)
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
301
        finally:
302
            if self.other_tree is not None:
303
                self.other_tree.unlock()
304
            if self.base_tree is not None:
305
                self.base_tree.unlock()
306
            self.this_tree.unlock()
1534.7.151 by Aaron Bentley
Fixed all changes applied successfully
307
        if len(merge.cooked_conflicts) == 0:
1534.7.141 by Aaron Bentley
Added conflict reporting
308
            if not self.ignore_zero:
309
                note("All changes applied successfully.")
310
        else:
311
            note("%d conflicts encountered." % len(merge.cooked_conflicts))
312
2100.3.29 by Aaron Bentley
Get merge working initially
313
        if self.recurse == 'down':
314
            for path, entry in self.this_tree.iter_reference_entries():
315
                sub_tree = self.this_tree.get_nested_tree(entry, path)
316
                other_entry = self.other_tree.inventory[entry.file_id]
317
                other_revision = self.other_tree.get_reference_revision(
318
                    other_entry, path)
319
                if  other_revision == sub_tree.last_revision():
320
                    continue
321
                sub_merge = Merger(sub_tree.branch, this_tree=sub_tree)
322
                sub_merge.merge_type = self.merge_type
323
                other_branch = self.other_branch.reference_parent(
324
                    entry.file_id, path)
325
                sub_merge.set_other_revision(other_revision, other_branch)
326
                base_entry = self.base_tree.inventory[entry.file_id]
327
                base_revision = \
328
                    self.base_tree.get_reference_revision(base_entry)
329
                sub_merge.base_tree = \
330
                    sub_tree.branch.repository.revision_tree(base_revision)
331
                sub_merge.do_merge()
332
1534.7.134 by Aaron Bentley
Hid raw conflicts
333
        return len(merge.cooked_conflicts)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
334
335
    def regen_inventory(self, new_entries):
1534.4.26 by Robert Collins
Move working tree initialisation out from Branch.initialize, deprecated Branch.initialize to Branch.create.
336
        old_entries = self.this_tree.read_working_inventory()
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
337
        new_inventory = {}
338
        by_path = {}
339
        new_entries_map = {} 
340
        for path, file_id in new_entries:
341
            if path is None:
342
                continue
343
            new_entries_map[file_id] = path
344
345
        def id2path(file_id):
346
            path = new_entries_map.get(file_id)
347
            if path is not None:
348
                return path
349
            entry = old_entries[file_id]
350
            if entry.parent_id is None:
351
                return entry.name
1185.31.32 by John Arbash Meinel
Updated the bzr sourcecode to use bzrlib.osutils.pathjoin rather than os.path.join to enforce internal use of / instead of \
352
            return pathjoin(id2path(entry.parent_id), entry.name)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
353
            
354
        for file_id in old_entries:
355
            entry = old_entries[file_id]
356
            path = id2path(file_id)
1185.80.5 by John Arbash Meinel
Changing the escaping just a little bit. Now we can handle unicode characters.
357
            if file_id in self.base_tree.inventory:
358
                executable = getattr(self.base_tree.inventory[file_id], 'executable', False)
359
            else:
360
                executable = getattr(entry, 'executable', False)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
361
            new_inventory[file_id] = (path, file_id, entry.parent_id, 
1185.80.5 by John Arbash Meinel
Changing the escaping just a little bit. Now we can handle unicode characters.
362
                                      entry.kind, executable)
363
                                      
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
364
            by_path[path] = file_id
974.1.21 by aaron.bentley at utoronto
Handled path generation properly
365
        
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
366
        deletions = 0
367
        insertions = 0
368
        new_path_list = []
369
        for path, file_id in new_entries:
370
            if path is None:
371
                del new_inventory[file_id]
372
                deletions += 1
373
            else:
374
                new_path_list.append((path, file_id))
375
                if file_id not in old_entries:
376
                    insertions += 1
377
        # Ensure no file is added before its parent
378
        new_path_list.sort()
379
        for path, file_id in new_path_list:
380
            if path == '':
381
                parent = None
382
            else:
383
                parent = by_path[os.path.dirname(path)]
1185.31.32 by John Arbash Meinel
Updated the bzr sourcecode to use bzrlib.osutils.pathjoin rather than os.path.join to enforce internal use of / instead of \
384
            abspath = pathjoin(self.this_tree.basedir, path)
2094.3.5 by John Arbash Meinel
Fix imports to ensure modules are loaded before they are used
385
            kind = osutils.file_kind(abspath)
1185.80.4 by John Arbash Meinel
We need to reference the basis_tree to get the proper executable bits.
386
            if file_id in self.base_tree.inventory:
1185.80.5 by John Arbash Meinel
Changing the escaping just a little bit. Now we can handle unicode characters.
387
                executable = getattr(self.base_tree.inventory[file_id], 'executable', False)
1185.80.4 by John Arbash Meinel
We need to reference the basis_tree to get the proper executable bits.
388
            else:
389
                executable = False
390
            new_inventory[file_id] = (path, file_id, parent, kind, executable)
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
391
            by_path[path] = file_id 
493 by Martin Pool
- Merge aaron's merge command
392
1185.12.76 by Aaron Bentley
Refactored merge and merge_inner to use Merger
393
        # Get a list in insertion order
394
        new_inventory_list = new_inventory.values()
395
        mutter ("""Inventory regeneration:
396
    old length: %i insertions: %i deletions: %i new_length: %i"""\
397
            % (len(old_entries), insertions, deletions, 
398
               len(new_inventory_list)))
399
        assert len(new_inventory_list) == len(old_entries) + insertions\
400
            - deletions
401
        new_inventory_list.sort()
402
        return new_inventory_list
974.1.9 by Aaron Bentley
Added merge-type parameter to merge.
403
1545.2.4 by Aaron Bentley
PEP8 fixes
404
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
405
class Merge3Merger(object):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
406
    """Three-way merger that uses the merge3 text merger"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
407
    requires_base = True
408
    supports_reprocess = True
409
    supports_show_base = True
410
    history_based = False
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
411
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
412
    def __init__(self, working_tree, this_tree, base_tree, other_tree, 
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
413
                 interesting_ids=None, reprocess=False, show_base=False,
1551.11.9 by Aaron Bentley
Apply change reporting to merge
414
                 pb=DummyProgress(), pp=None, change_reporter=None):
1534.7.157 by Aaron Bentley
Added more docs
415
        """Initialize the merger object and perform the merge."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
416
        object.__init__(self)
417
        self.this_tree = working_tree
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
418
        self.this_tree.lock_tree_write()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
419
        self.base_tree = base_tree
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
420
        self.base_tree.lock_read()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
421
        self.other_tree = other_tree
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
422
        self.other_tree.lock_read()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
423
        self._raw_conflicts = []
424
        self.cooked_conflicts = []
425
        self.reprocess = reprocess
426
        self.show_base = show_base
1534.9.1 by Aaron Bentley
Added progress bars to merge
427
        self.pb = pb
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
428
        self.pp = pp
1551.11.9 by Aaron Bentley
Apply change reporting to merge
429
        self.change_reporter = change_reporter
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
430
        if self.pp is None:
431
            self.pp = ProgressPhase("Merge phase", 3, self.pb)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
432
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
433
        if interesting_ids is not None:
434
            all_ids = interesting_ids
435
        else:
436
            all_ids = set(base_tree)
437
            all_ids.update(other_tree)
1534.9.1 by Aaron Bentley
Added progress bars to merge
438
        self.tt = TreeTransform(working_tree, self.pb)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
439
        try:
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
440
            self.pp.next_phase()
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
441
            child_pb = ui.ui_factory.nested_progress_bar()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
442
            try:
443
                for num, file_id in enumerate(all_ids):
444
                    child_pb.update('Preparing file merge', num, len(all_ids))
445
                    self.merge_names(file_id)
446
                    file_status = self.merge_contents(file_id)
447
                    self.merge_executable(file_id, file_status)
448
            finally:
449
                child_pb.finished()
1731.1.33 by Aaron Bentley
Revert no-special-root changes
450
            self.fix_root()
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
451
            self.pp.next_phase()
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
452
            child_pb = ui.ui_factory.nested_progress_bar()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
453
            try:
454
                fs_conflicts = resolve_conflicts(self.tt, child_pb)
455
            finally:
456
                child_pb.finished()
1551.11.9 by Aaron Bentley
Apply change reporting to merge
457
            if change_reporter is not None:
1551.11.12 by Aaron Bentley
Changes from review
458
                from bzrlib import delta
1551.11.9 by Aaron Bentley
Apply change reporting to merge
459
                delta.report_changes(self.tt._iter_changes(), change_reporter)
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
460
            self.cook_conflicts(fs_conflicts)
1534.10.24 by Aaron Bentley
Eliminated conflicts_to_strings, made remove_files a ConflictList member
461
            for conflict in self.cooked_conflicts:
462
                warning(conflict)
1551.2.32 by Aaron Bentley
Handle progress phases more nicely in merge
463
            self.pp.next_phase()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
464
            results = self.tt.apply()
1558.4.3 by Aaron Bentley
Merge_modified performance/concurrency fix
465
            self.write_modified(results)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
466
            try:
1551.7.11 by Aaron Bentley
Add WorkingTree.add_conflicts
467
                working_tree.add_conflicts(self.cooked_conflicts)
1534.10.12 by Aaron Bentley
Merge produces new conflicts
468
            except UnsupportedOperation:
469
                pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
470
        finally:
1711.7.7 by John Arbash Meinel
Don't squelch errors in tt.finalize()
471
            self.tt.finalize()
2255.7.52 by Robert Collins
Lock trees in Merge3Merger correctly.
472
            self.other_tree.unlock()
473
            self.base_tree.unlock()
474
            self.this_tree.unlock()
1551.2.31 by Aaron Bentley
Got merge and revert using nested pbs
475
            self.pb.clear()
1534.7.192 by Aaron Bentley
Record hashes produced by merges
476
1731.1.33 by Aaron Bentley
Revert no-special-root changes
477
    def fix_root(self):
478
        try:
479
            self.tt.final_kind(self.tt.root)
480
        except NoSuchFile:
481
            self.tt.cancel_deletion(self.tt.root)
482
        if self.tt.final_file_id(self.tt.root) is None:
483
            self.tt.version_file(self.tt.tree_file_id(self.tt.root), 
484
                                 self.tt.root)
485
        if self.other_tree.inventory.root is None:
486
            return
487
        other_root_file_id = self.other_tree.inventory.root.file_id
488
        other_root = self.tt.trans_id_file_id(other_root_file_id)
489
        if other_root == self.tt.root:
490
            return
491
        try:
492
            self.tt.final_kind(other_root)
493
        except NoSuchFile:
494
            return
495
        self.reparent_children(self.other_tree.inventory.root, self.tt.root)
496
        self.tt.cancel_creation(other_root)
497
        self.tt.cancel_versioning(other_root)
498
499
    def reparent_children(self, ie, target):
500
        for thing, child in ie.children.iteritems():
501
            trans_id = self.tt.trans_id_file_id(child.file_id)
502
            self.tt.adjust_path(self.tt.final_name(trans_id), target, trans_id)
503
1534.7.192 by Aaron Bentley
Record hashes produced by merges
504
    def write_modified(self, results):
505
        modified_hashes = {}
506
        for path in results.modified_paths:
507
            file_id = self.this_tree.path2id(self.this_tree.relpath(path))
508
            if file_id is None:
509
                continue
510
            hash = self.this_tree.get_file_sha1(file_id)
511
            if hash is None:
512
                continue
513
            modified_hashes[file_id] = hash
514
        self.this_tree.set_merge_modified(modified_hashes)
515
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
516
    @staticmethod
517
    def parent(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
518
        """Determine the parent for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
519
        if entry is None:
520
            return None
521
        return entry.parent_id
522
523
    @staticmethod
524
    def name(entry, file_id):
1534.7.157 by Aaron Bentley
Added more docs
525
        """Determine the name for a file_id (used as a key method)"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
526
        if entry is None:
527
            return None
528
        return entry.name
529
    
530
    @staticmethod
531
    def contents_sha1(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
532
        """Determine the sha1 of the file contents (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
533
        if file_id not in tree:
534
            return None
535
        return tree.get_file_sha1(file_id)
536
537
    @staticmethod
538
    def executable(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
539
        """Determine the executability of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
540
        if file_id not in tree:
541
            return None
542
        if tree.kind(file_id) != "file":
543
            return False
544
        return tree.is_executable(file_id)
545
546
    @staticmethod
547
    def kind(tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
548
        """Determine the kind of a file-id (used as a key method)."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
549
        if file_id not in tree:
550
            return None
551
        return tree.kind(file_id)
552
553
    @staticmethod
554
    def scalar_three_way(this_tree, base_tree, other_tree, file_id, key):
555
        """Do a three-way test on a scalar.
556
        Return "this", "other" or "conflict", depending whether a value wins.
557
        """
558
        key_base = key(base_tree, file_id)
559
        key_other = key(other_tree, file_id)
560
        #if base == other, either they all agree, or only THIS has changed.
561
        if key_base == key_other:
562
            return "this"
563
        key_this = key(this_tree, file_id)
564
        if key_this not in (key_base, key_other):
565
            return "conflict"
566
        # "Ambiguous clean merge"
567
        elif key_this == key_other:
568
            return "this"
569
        else:
570
            assert key_this == key_base
571
            return "other"
572
573
    def merge_names(self, file_id):
1534.7.157 by Aaron Bentley
Added more docs
574
        """Perform a merge on file_id names and parents"""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
575
        def get_entry(tree):
576
            if file_id in tree.inventory:
577
                return tree.inventory[file_id]
578
            else:
579
                return None
580
        this_entry = get_entry(self.this_tree)
581
        other_entry = get_entry(self.other_tree)
582
        base_entry = get_entry(self.base_tree)
583
        name_winner = self.scalar_three_way(this_entry, base_entry, 
584
                                            other_entry, file_id, self.name)
585
        parent_id_winner = self.scalar_three_way(this_entry, base_entry, 
586
                                                 other_entry, file_id, 
587
                                                 self.parent)
588
        if this_entry is None:
589
            if name_winner == "this":
590
                name_winner = "other"
591
            if parent_id_winner == "this":
592
                parent_id_winner = "other"
593
        if name_winner == "this" and parent_id_winner == "this":
594
            return
595
        if name_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
596
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
597
            self._raw_conflicts.append(('name conflict', trans_id, 
598
                                        self.name(this_entry, file_id), 
599
                                        self.name(other_entry, file_id)))
600
        if parent_id_winner == "conflict":
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
601
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
602
            self._raw_conflicts.append(('parent conflict', trans_id, 
603
                                        self.parent(this_entry, file_id), 
604
                                        self.parent(other_entry, file_id)))
605
        if other_entry is None:
606
            # it doesn't matter whether the result was 'other' or 
607
            # 'conflict'-- if there's no 'other', we leave it alone.
608
            return
609
        # if we get here, name_winner and parent_winner are set to safe values.
610
        winner_entry = {"this": this_entry, "other": other_entry, 
611
                        "conflict": other_entry}
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
612
        trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
613
        parent_id = winner_entry[parent_id_winner].parent_id
1731.1.33 by Aaron Bentley
Revert no-special-root changes
614
        if parent_id is not None:
615
            parent_trans_id = self.tt.trans_id_file_id(parent_id)
616
            self.tt.adjust_path(winner_entry[name_winner].name, 
617
                                parent_trans_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
618
619
    def merge_contents(self, file_id):
1534.7.157 by Aaron Bentley
Added more docs
620
        """Performa a merge on file_id contents."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
621
        def contents_pair(tree):
622
            if file_id not in tree:
623
                return (None, None)
624
            kind = tree.kind(file_id)
625
            if kind == "file":
626
                contents = tree.get_file_sha1(file_id)
627
            elif kind == "symlink":
628
                contents = tree.get_symlink_target(file_id)
629
            else:
630
                contents = None
631
            return kind, contents
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
632
633
        def contents_conflict():
634
            trans_id = self.tt.trans_id_file_id(file_id)
635
            name = self.tt.final_name(trans_id)
636
            parent_id = self.tt.final_parent(trans_id)
637
            if file_id in self.this_tree.inventory:
638
                self.tt.unversion_file(trans_id)
1551.10.2 by Aaron Bentley
Handle merge with dangling inventory entries
639
                if file_id in self.this_tree:
640
                    self.tt.delete_contents(trans_id)
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
641
            file_group = self._dump_conflicts(name, parent_id, file_id, 
642
                                              set_version=True)
643
            self._raw_conflicts.append(('contents conflict', file_group))
644
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
645
        # See SPOT run.  run, SPOT, run.
646
        # So we're not QUITE repeating ourselves; we do tricky things with
647
        # file kind...
648
        base_pair = contents_pair(self.base_tree)
649
        other_pair = contents_pair(self.other_tree)
650
        if base_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
651
            # OTHER introduced no changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
652
            return "unmodified"
653
        this_pair = contents_pair(self.this_tree)
654
        if this_pair == other_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
655
            # THIS and OTHER introduced the same changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
656
            return "unmodified"
657
        else:
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
658
            trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
659
            if this_pair == base_pair:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
660
                # only OTHER introduced changes
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
661
                if file_id in self.this_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
662
                    # Remove any existing contents
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
663
                    self.tt.delete_contents(trans_id)
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
664
                if file_id in self.other_tree:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
665
                    # OTHER changed the file
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
666
                    create_by_entry(self.tt, 
667
                                    self.other_tree.inventory[file_id], 
668
                                    self.other_tree, trans_id)
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
669
                    if file_id not in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
670
                        self.tt.version_file(file_id, trans_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
671
                    return "modified"
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
672
                elif file_id in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
673
                    # OTHER deleted the file
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
674
                    self.tt.unversion_file(trans_id)
675
                    return "deleted"
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
676
            #BOTH THIS and OTHER introduced changes; scalar conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
677
            elif this_pair[0] == "file" and other_pair[0] == "file":
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
678
                # THIS and OTHER are both files, so text merge.  Either
679
                # BASE is a file, or both converted to files, so at least we
680
                # have agreement that output should be a file.
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
681
                try:
682
                    self.text_merge(file_id, trans_id)
683
                except BinaryFile:
684
                    return contents_conflict()
1534.7.147 by Aaron Bentley
Tweak to check inventory, not tree for file ids
685
                if file_id not in self.this_tree.inventory:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
686
                    self.tt.version_file(file_id, trans_id)
1534.7.152 by Aaron Bentley
Fixed overwrites
687
                try:
688
                    self.tt.tree_kind(trans_id)
689
                    self.tt.delete_contents(trans_id)
690
                except NoSuchFile:
691
                    pass
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
692
                return "modified"
693
            else:
1534.7.145 by Aaron Bentley
More fixups after get_trans_id
694
                # Scalar conflict, can't text merge.  Dump conflicts
1558.15.3 by Aaron Bentley
Handle binary files for diff3 merges
695
                return contents_conflict()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
696
697
    def get_lines(self, tree, file_id):
1534.7.157 by Aaron Bentley
Added more docs
698
        """Return the lines in a file, or an empty list."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
699
        if file_id in tree:
700
            return tree.get_file(file_id).readlines()
701
        else:
702
            return []
703
704
    def text_merge(self, file_id, trans_id):
705
        """Perform a three-way text merge on a file_id"""
706
        # it's possible that we got here with base as a different type.
707
        # if so, we just want two-way text conflicts.
708
        if file_id in self.base_tree and \
709
            self.base_tree.kind(file_id) == "file":
710
            base_lines = self.get_lines(self.base_tree, file_id)
711
        else:
712
            base_lines = []
713
        other_lines = self.get_lines(self.other_tree, file_id)
714
        this_lines = self.get_lines(self.this_tree, file_id)
715
        m3 = Merge3(base_lines, this_lines, other_lines)
716
        start_marker = "!START OF MERGE CONFLICT!" + "I HOPE THIS IS UNIQUE"
717
        if self.show_base is True:
718
            base_marker = '|' * 7
719
        else:
720
            base_marker = None
721
722
        def iter_merge3(retval):
723
            retval["text_conflicts"] = False
724
            for line in m3.merge_lines(name_a = "TREE", 
725
                                       name_b = "MERGE-SOURCE", 
726
                                       name_base = "BASE-REVISION",
727
                                       start_marker=start_marker, 
728
                                       base_marker=base_marker,
729
                                       reprocess=self.reprocess):
730
                if line.startswith(start_marker):
731
                    retval["text_conflicts"] = True
732
                    yield line.replace(start_marker, '<' * 7)
733
                else:
734
                    yield line
735
        retval = {}
736
        merge3_iterator = iter_merge3(retval)
737
        self.tt.create_file(merge3_iterator, trans_id)
738
        if retval["text_conflicts"] is True:
739
            self._raw_conflicts.append(('text conflict', trans_id))
740
            name = self.tt.final_name(trans_id)
741
            parent_id = self.tt.final_parent(trans_id)
742
            file_group = self._dump_conflicts(name, parent_id, file_id, 
743
                                              this_lines, base_lines,
744
                                              other_lines)
745
            file_group.append(trans_id)
746
747
    def _dump_conflicts(self, name, parent_id, file_id, this_lines=None, 
748
                        base_lines=None, other_lines=None, set_version=False,
749
                        no_base=False):
1534.7.157 by Aaron Bentley
Added more docs
750
        """Emit conflict files.
751
        If this_lines, base_lines, or other_lines are omitted, they will be
752
        determined automatically.  If set_version is true, the .OTHER, .THIS
753
        or .BASE (in that order) will be created as versioned files.
754
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
755
        data = [('OTHER', self.other_tree, other_lines), 
756
                ('THIS', self.this_tree, this_lines)]
757
        if not no_base:
758
            data.append(('BASE', self.base_tree, base_lines))
759
        versioned = False
760
        file_group = []
761
        for suffix, tree, lines in data:
762
            if file_id in tree:
763
                trans_id = self._conflict_file(name, parent_id, tree, file_id,
764
                                               suffix, lines)
765
                file_group.append(trans_id)
766
                if set_version and not versioned:
767
                    self.tt.version_file(file_id, trans_id)
768
                    versioned = True
769
        return file_group
770
           
771
    def _conflict_file(self, name, parent_id, tree, file_id, suffix, 
772
                       lines=None):
1534.7.157 by Aaron Bentley
Added more docs
773
        """Emit a single conflict file."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
774
        name = name + '.' + suffix
775
        trans_id = self.tt.create_path(name, parent_id)
776
        entry = tree.inventory[file_id]
777
        create_by_entry(self.tt, entry, tree, trans_id, lines)
778
        return trans_id
779
780
    def merge_executable(self, file_id, file_status):
1534.7.157 by Aaron Bentley
Added more docs
781
        """Perform a merge on the execute bit."""
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
782
        if file_status == "deleted":
783
            return
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
784
        trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
785
        try:
786
            if self.tt.final_kind(trans_id) != "file":
787
                return
788
        except NoSuchFile:
789
            return
790
        winner = self.scalar_three_way(self.this_tree, self.base_tree, 
791
                                       self.other_tree, file_id, 
792
                                       self.executable)
793
        if winner == "conflict":
794
        # There must be a None in here, if we have a conflict, but we
795
        # need executability since file status was not deleted.
1534.10.35 by Aaron Bentley
Merge handles contents + executable + deletion conflict
796
            if self.executable(self.other_tree, file_id) is None:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
797
                winner = "this"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
798
            else:
1534.7.142 by Aaron Bentley
Fixed executability conflicts
799
                winner = "other"
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
800
        if winner == "this":
801
            if file_status == "modified":
802
                executability = self.this_tree.is_executable(file_id)
803
                if executability is not None:
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
804
                    trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
805
                    self.tt.set_executability(executability, trans_id)
806
        else:
807
            assert winner == "other"
808
            if file_id in self.other_tree:
809
                executability = self.other_tree.is_executable(file_id)
810
            elif file_id in self.this_tree:
811
                executability = self.this_tree.is_executable(file_id)
812
            elif file_id in self.base_tree:
813
                executability = self.base_tree.is_executable(file_id)
814
            if executability is not None:
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
815
                trans_id = self.tt.trans_id_file_id(file_id)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
816
                self.tt.set_executability(executability, trans_id)
817
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
818
    def cook_conflicts(self, fs_conflicts):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
819
        """Convert all conflicts into a form that doesn't depend on trans_id"""
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
820
        from conflicts import Conflict
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
821
        name_conflicts = {}
1534.7.172 by Aaron Bentley
Integrated fs conflicts with merge conflicts.
822
        self.cooked_conflicts.extend(cook_conflicts(fs_conflicts, self.tt))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
823
        fp = FinalPaths(self.tt)
824
        for conflict in self._raw_conflicts:
825
            conflict_type = conflict[0]
826
            if conflict_type in ('name conflict', 'parent conflict'):
827
                trans_id = conflict[1]
828
                conflict_args = conflict[2:]
829
                if trans_id not in name_conflicts:
830
                    name_conflicts[trans_id] = {}
831
                unique_add(name_conflicts[trans_id], conflict_type, 
832
                           conflict_args)
833
            if conflict_type == 'contents conflict':
834
                for trans_id in conflict[1]:
835
                    file_id = self.tt.final_file_id(trans_id)
836
                    if file_id is not None:
837
                        break
838
                path = fp.get_path(trans_id)
839
                for suffix in ('.BASE', '.THIS', '.OTHER'):
840
                    if path.endswith(suffix):
841
                        path = path[:-len(suffix)]
842
                        break
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
843
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
844
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
845
            if conflict_type == 'text conflict':
846
                trans_id = conflict[1]
847
                path = fp.get_path(trans_id)
848
                file_id = self.tt.final_file_id(trans_id)
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
849
                c = Conflict.factory(conflict_type, path=path, file_id=file_id)
850
                self.cooked_conflicts.append(c)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
851
852
        for trans_id, conflicts in name_conflicts.iteritems():
853
            try:
854
                this_parent, other_parent = conflicts['parent conflict']
855
                assert this_parent != other_parent
856
            except KeyError:
857
                this_parent = other_parent = \
858
                    self.tt.final_file_id(self.tt.final_parent(trans_id))
859
            try:
860
                this_name, other_name = conflicts['name conflict']
861
                assert this_name != other_name
862
            except KeyError:
863
                this_name = other_name = self.tt.final_name(trans_id)
864
            other_path = fp.get_path(trans_id)
865
            if this_parent is not None:
866
                this_parent_path = \
1534.7.181 by Aaron Bentley
Renamed a bunch of functions
867
                    fp.get_path(self.tt.trans_id_file_id(this_parent))
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
868
                this_path = pathjoin(this_parent_path, this_name)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
869
            else:
870
                this_path = "<deleted>"
871
            file_id = self.tt.final_file_id(trans_id)
1534.10.20 by Aaron Bentley
Got all tests passing
872
            c = Conflict.factory('path conflict', path=this_path,
1534.10.19 by Aaron Bentley
Stanza conversion, cooking
873
                                 conflict_path=other_path, file_id=file_id)
874
            self.cooked_conflicts.append(c)
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
875
        self.cooked_conflicts.sort(key=Conflict.sort_key)
1534.7.141 by Aaron Bentley
Added conflict reporting
876
877
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
878
class WeaveMerger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
879
    """Three-way tree merger, text weave merger."""
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
880
    supports_reprocess = True
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
881
    supports_show_base = False
882
1534.9.1 by Aaron Bentley
Added progress bars to merge
883
    def __init__(self, working_tree, this_tree, base_tree, other_tree, 
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
884
                 interesting_ids=None, pb=DummyProgress(), pp=None,
1551.11.11 by Aaron Bentley
Get tests passing
885
                 reprocess=False, change_reporter=None):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
886
        self.this_revision_tree = self._get_revision_tree(this_tree)
887
        self.other_revision_tree = self._get_revision_tree(other_tree)
888
        super(WeaveMerger, self).__init__(working_tree, this_tree, 
1558.2.2 by Aaron Bentley
Make remerge honour interesting-ids
889
                                          base_tree, other_tree, 
890
                                          interesting_ids=interesting_ids, 
1551.11.11 by Aaron Bentley
Get tests passing
891
                                          pb=pb, pp=pp, reprocess=reprocess,
892
                                          change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
893
894
    def _get_revision_tree(self, tree):
1759.2.1 by Jelmer Vernooij
Fix some types (found using aspell).
895
        """Return a revision tree related to this tree.
1534.7.157 by Aaron Bentley
Added more docs
896
        If the tree is a WorkingTree, the basis will be returned.
897
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
898
        if getattr(tree, 'get_weave', False) is False:
899
            # If we have a WorkingTree, try using the basis
900
            return tree.branch.basis_tree()
901
        else:
902
            return tree
903
904
    def _check_file(self, file_id):
905
        """Check that the revision tree's version of the file matches."""
906
        for tree, rt in ((self.this_tree, self.this_revision_tree), 
907
                         (self.other_tree, self.other_revision_tree)):
908
            if rt is tree:
909
                continue
910
            if tree.get_file_sha1(file_id) != rt.get_file_sha1(file_id):
911
                raise WorkingTreeNotRevision(self.this_tree)
912
913
    def _merged_lines(self, file_id):
914
        """Generate the merged lines.
915
        There is no distinction between lines that are meant to contain <<<<<<<
916
        and conflicts.
917
        """
918
        weave = self.this_revision_tree.get_weave(file_id)
919
        this_revision_id = self.this_revision_tree.inventory[file_id].revision
920
        other_revision_id = \
921
            self.other_revision_tree.inventory[file_id].revision
1551.6.10 by Aaron Bentley
Renamed WeaveMerge to PlanMerge, added plan method, created planless WeaveMerge
922
        wm = WeaveMerge(weave, this_revision_id, other_revision_id, 
923
                        '<<<<<<< TREE\n', '>>>>>>> MERGE-SOURCE\n')
1551.6.8 by Aaron Bentley
Implemented reprocess for weave
924
        return wm.merge_lines(self.reprocess)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
925
926
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
927
        """Perform a (weave) text merge for a given file and file-id.
928
        If conflicts are encountered, .THIS and .OTHER files will be emitted,
929
        and a conflict will be noted.
930
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
931
        self._check_file(file_id)
1551.6.12 by Aaron Bentley
Indicate conflicts from merge_lines, insead of guessing
932
        lines, conflicts = self._merged_lines(file_id)
1558.15.10 by Aaron Bentley
Merge bzr.dev
933
        lines = list(lines)
1558.15.5 by Aaron Bentley
Fixed binary handling in weave merge
934
        # Note we're checking whether the OUTPUT is binary in this case, 
935
        # because we don't want to get into weave merge guts.
936
        check_text_lines(lines)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
937
        self.tt.create_file(lines, trans_id)
938
        if conflicts:
939
            self._raw_conflicts.append(('text conflict', trans_id))
940
            name = self.tt.final_name(trans_id)
941
            parent_id = self.tt.final_parent(trans_id)
942
            file_group = self._dump_conflicts(name, parent_id, file_id, 
943
                                              no_base=True)
944
            file_group.append(trans_id)
945
946
947
class Diff3Merger(Merge3Merger):
1534.7.167 by Aaron Bentley
PEP8 and comment cleanups
948
    """Three-way merger using external diff3 for text merging"""
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
949
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
950
    def dump_file(self, temp_dir, name, tree, file_id):
951
        out_path = pathjoin(temp_dir, name)
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
952
        out_file = open(out_path, "wb")
953
        try:
954
            in_file = tree.get_file(file_id)
955
            for line in in_file:
956
                out_file.write(line)
957
        finally:
958
            out_file.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
959
        return out_path
960
961
    def text_merge(self, file_id, trans_id):
1534.7.157 by Aaron Bentley
Added more docs
962
        """Perform a diff3 merge using a specified file-id and trans-id.
963
        If conflicts are encountered, .BASE, .THIS. and .OTHER conflict files
964
        will be dumped, and a will be conflict noted.
965
        """
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
966
        import bzrlib.patch
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
967
        temp_dir = osutils.mkdtemp(prefix="bzr-")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
968
        try:
1534.7.166 by Aaron Bentley
Swapped os.path.join for pathjoin everywhere
969
            new_file = pathjoin(temp_dir, "new")
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
970
            this = self.dump_file(temp_dir, "this", self.this_tree, file_id)
971
            base = self.dump_file(temp_dir, "base", self.base_tree, file_id)
972
            other = self.dump_file(temp_dir, "other", self.other_tree, file_id)
973
            status = bzrlib.patch.diff3(new_file, this, base, other)
974
            if status not in (0, 1):
975
                raise BzrError("Unhandled diff3 exit code")
1711.7.20 by John Arbash Meinel
always close files, minor PEP8 cleanup
976
            f = open(new_file, 'rb')
977
            try:
978
                self.tt.create_file(f, trans_id)
979
            finally:
980
                f.close()
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
981
            if status == 1:
982
                name = self.tt.final_name(trans_id)
983
                parent_id = self.tt.final_parent(trans_id)
984
                self._dump_conflicts(name, parent_id, file_id)
1551.8.39 by Aaron Bentley
Fix diff3 conflict-reporting bug
985
                self._raw_conflicts.append(('text conflict', trans_id))
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
986
        finally:
1996.3.18 by John Arbash Meinel
Now that mkdtemp and rmtree are lazy, they should not be directly improted.
987
            osutils.rmtree(temp_dir)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
988
989
990
def merge_inner(this_branch, other_tree, base_tree, ignore_zero=False,
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
991
                backup_files=False,
992
                merge_type=Merge3Merger,
993
                interesting_ids=None,
994
                show_base=False,
995
                reprocess=False,
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
996
                other_rev_id=None,
997
                interesting_files=None,
1534.9.9 by Aaron Bentley
Added progress bar to pull
998
                this_tree=None,
1551.11.10 by Aaron Bentley
Add change reporting to pull
999
                pb=DummyProgress(),
1000
                change_reporter=None):
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1001
    """Primary interface for merging. 
1002
1003
        typical use is probably 
1004
        'merge_inner(branch, branch.get_revision_tree(other_revision),
1005
                     branch.get_revision_tree(base_revision))'
1006
        """
1007
    if this_tree is None:
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
1008
        warnings.warn("bzrlib.merge.merge_inner requires a this_tree parameter as of "
1563.1.1 by Robert Collins
Fixup internally generated deprecation warning from merge_inner.
1009
             "bzrlib version 0.8.",
1010
             DeprecationWarning,
1011
             stacklevel=2)
1012
        this_tree = this_branch.bzrdir.open_workingtree()
2255.2.31 by Robert Collins
Work in progress to make merge_inner work with dirstate trees.
1013
    merger = Merger(this_branch, other_tree, base_tree, this_tree=this_tree,
1551.11.10 by Aaron Bentley
Add change reporting to pull
1014
                    pb=pb, change_reporter=change_reporter)
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1015
    merger.backup_files = backup_files
1016
    merger.merge_type = merge_type
1017
    merger.interesting_ids = interesting_ids
1551.2.23 by Aaron Bentley
Got merge_inner's ignore_zero parameter working
1018
    merger.ignore_zero = ignore_zero
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1019
    if interesting_files:
1020
        assert not interesting_ids, ('Only supply interesting_ids'
1021
                                     ' or interesting_files')
1022
        merger._set_interesting_files(interesting_files)
1979.2.1 by Robert Collins
(robertc) adds a convenience method "merge_from_branch" to WorkingTree.
1023
    merger.show_base = show_base
1534.7.140 by Aaron Bentley
Moved the merge stuff into merge.py
1024
    merger.reprocess = reprocess
1025
    merger.other_rev_id = other_rev_id
1026
    merger.other_basis = other_rev_id
1027
    return merger.do_merge()
1028
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1029
def get_merge_type_registry():
2221.4.17 by Aaron Bentley
PEP8-ness
1030
    """Merge type registry is in bzrlib.option to avoid circular imports.
2221.4.15 by Aaron Bentley
Use RegistryOption for merge type
1031
1032
    This method provides a sanctioned way to retrieve it.
1033
    """
1034
    from bzrlib import option
2221.4.16 by Aaron Bentley
Add tests for get_merge_type_registry
1035
    return option._merge_type_registry