/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
2374.2.2 by John Arbash Meinel
Fix the small bug that ie.snapshot() didn't think about kind changes.
1
# Copyright (C) 2005, 2006, 2007 Canonical Ltd
1887.1.1 by Adeodato Simó
Do not separate paragraphs in the copyright statement with blank lines,
2
#
485 by Martin Pool
- move commit code into its own module
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1248 by Martin Pool
- new weave based cleanup [broken]
7
#
485 by Martin Pool
- move commit code into its own module
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
1248 by Martin Pool
- new weave based cleanup [broken]
12
#
485 by Martin Pool
- move commit code into its own module
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
17
1248 by Martin Pool
- new weave based cleanup [broken]
18
# The newly committed revision is going to have a shape corresponding
19
# to that of the working inventory.  Files that are not in the
20
# working tree and that were in the predecessor are reported as
21
# removed --- this can include files that were either removed from the
22
# inventory or deleted in the working tree.  If they were only
23
# deleted from disk, they are removed from the working inventory.
24
25
# We then consider the remaining entries, which will be in the new
26
# version.  Directory entries are simply copied across.  File entries
27
# must be checked to see if a new version of the file should be
28
# recorded.  For each parent revision inventory, we check to see what
29
# version of the file was present.  If the file was present in at
30
# least one tree, and if it was the same version in all the trees,
31
# then we can just refer to that version.  Otherwise, a new version
32
# representing the merger of the file versions must be added.
33
34
# TODO: Update hashcache before and after - or does the WorkingTree
35
# look after that?
1245 by Martin Pool
doc
36
1339 by Martin Pool
- doc
37
# TODO: Rather than mashing together the ancestry and storing it back,
38
# perhaps the weave should have single method which does it all in one
39
# go, avoiding a lot of redundant work.
1335 by Martin Pool
doc
40
1341 by Martin Pool
- doc
41
# TODO: Perhaps give a warning if one of the revisions marked as
42
# merged is already in the ancestry, and then don't record it as a
43
# distinct parent.
44
1343 by Martin Pool
- fix up test for merge of trees
45
# TODO: If the file is newly merged but unchanged from the version it
46
# merges from, then it should still be reported as newly added
47
# relative to the basis revision.
48
1910.7.17 by Andrew Bennetts
Various cosmetic changes.
49
# TODO: Change the parameter 'rev_id' to 'revision_id' to be consistent with
50
# the rest of the code; add a deprecation of the old name.
1194 by Martin Pool
- [BROKEN] more progress of commit into weaves
51
1189 by Martin Pool
- BROKEN: partial support for commit into weave
52
import os
1390 by Robert Collins
pair programming worx... merge integration and weave
53
import re
1189 by Martin Pool
- BROKEN: partial support for commit into weave
54
import sys
1188 by Martin Pool
- clean up imports in commit code
55
import time
1194 by Martin Pool
- [BROKEN] more progress of commit into weaves
56
57
from cStringIO import StringIO
1188 by Martin Pool
- clean up imports in commit code
58
1551.8.30 by Aaron Bentley
Tweak from review comments
59
from bzrlib import (
2560.1.4 by Robert Collins
Allow -Dhooks to get the hooks invoked during commit logged.
60
    debug,
1551.8.30 by Aaron Bentley
Tweak from review comments
61
    errors,
1959.4.2 by Aaron Bentley
Merge bzr.dev
62
    inventory,
1551.8.30 by Aaron Bentley
Tweak from review comments
63
    tree,
64
    )
2246.1.3 by Robert Collins
New branch hooks: post_push, post_pull, post_commit, post_uncommit. These
65
from bzrlib.branch import Branch
1442.1.2 by Robert Collins
create a config module - there is enough config logic to make this worthwhile, and start testing config processing.
66
import bzrlib.config
1264 by Martin Pool
- Raise a better error from commit when a parent is absent
67
from bzrlib.errors import (BzrError, PointlessCommit,
1185.16.65 by mbp at sourcefrog
- new commit --strict option
68
                           ConflictsInTree,
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
69
                           StrictCommitFailed
1264 by Martin Pool
- Raise a better error from commit when a parent is absent
70
                           )
1740.3.10 by Jelmer Vernooij
Fix some minor issues pointed out by j-a-m.
71
from bzrlib.osutils import (kind_marker, isdir,isfile, is_inside_any, 
72
                            is_inside_or_parent_of_any,
73
                            quotefn, sha_file, split_lines)
1442.1.62 by Robert Collins
Allow creation of testaments from uncommitted data, and use that to get signatures before committing revisions.
74
from bzrlib.testament import Testament
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
75
from bzrlib.trace import mutter, note, warning, is_quiet
1189 by Martin Pool
- BROKEN: partial support for commit into weave
76
from bzrlib.xml5 import serializer_v5
1731.1.33 by Aaron Bentley
Revert no-special-root changes
77
from bzrlib.inventory import Inventory, InventoryEntry
1910.2.9 by Aaron Bentley
Inroduce assertDeprecated, and use it to test old commitbuilder API
78
from bzrlib import symbol_versioning
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
79
from bzrlib.symbol_versioning import (deprecated_passed,
1773.4.3 by Martin Pool
[merge] bzr.dev
80
        deprecated_function,
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
81
        DEPRECATED_PARAMETER)
1508.1.6 by Robert Collins
Move Branch.unknowns() to WorkingTree.
82
from bzrlib.workingtree import WorkingTree
2094.3.5 by John Arbash Meinel
Fix imports to ensure modules are loaded before they are used
83
import bzrlib.ui
1189 by Martin Pool
- BROKEN: partial support for commit into weave
84
85
86
class NullCommitReporter(object):
87
    """I report on progress of a commit."""
1185.12.8 by Aaron Bentley
Fixed commit so all output comes though CommitReporter
88
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
89
    def __init__(self, show_change_total=False):
90
        self.show_change_total = show_change_total
91
        self.changes = 0
1185.12.8 by Aaron Bentley
Fixed commit so all output comes though CommitReporter
92
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
93
    def _note(self, format, *args):
94
        """Output a message.
95
2522.2.3 by Ian Clatworthy
Revert logging just to stderr in commit as broke unicode filenames (#120930)
96
        Subclasses may choose to override this method.
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
97
        """
2522.2.3 by Ian Clatworthy
Revert logging just to stderr in commit as broke unicode filenames (#120930)
98
        note(format, *args)
1668.1.5 by Martin Pool
[broken] fix up display of files changed by a commit
99
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
100
    def _note_change(self, format, *args):
101
        self._note(format, *args)
102
        self.changes += 1
103
104
    def snapshot_change(self, change, path):
105
        pass
106
107
    def completed(self, revno, rev_id):
108
        pass
109
110
    def deleted(self, file_id):
111
        pass
112
113
    def escaped(self, escape_count, message):
114
        pass
115
116
    def missing(self, path):
117
        pass
118
119
    def renamed(self, change, old_path, new_path):
120
        pass
121
122
    def is_verbose(self):
123
        return False
124
125
126
class _InitialCommitReporter(NullCommitReporter):
127
128
    def snapshot_change(self, change, path):
2789.2.5 by Ian Clatworthy
Upgrade commit tests to reflect new reporting formats
129
        if path != '':
130
            self.changes += 1
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
131
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
132
    def completed(self, revno, rev_id):
2789.2.5 by Ian Clatworthy
Upgrade commit tests to reflect new reporting formats
133
        if not self.show_change_total:
134
            details = ''
135
        elif self.changes == 1:
136
            details = ' (%d change made)' % self.changes
137
        else:
138
            details = ' (%d changes made)' % self.changes
139
        self._note('Committed revision %d%s.', revno, details)
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
140
141
142
class ReportCommitToLog(_InitialCommitReporter):
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
143
1185.12.8 by Aaron Bentley
Fixed commit so all output comes though CommitReporter
144
    def snapshot_change(self, change, path):
1616.1.4 by Martin Pool
Verbose commit shouldn't talk about every unchanged file.
145
        if change == 'unchanged':
146
            return
1731.1.45 by Aaron Bentley
Merge bzr.dev
147
        if change == 'added' and path == '':
148
            return
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
149
        self._note_change("%s %s", change, path)
1185.12.8 by Aaron Bentley
Fixed commit so all output comes though CommitReporter
150
151
    def deleted(self, file_id):
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
152
        self._note_change('deleted %s', file_id)
1185.12.8 by Aaron Bentley
Fixed commit so all output comes though CommitReporter
153
154
    def escaped(self, escape_count, message):
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
155
        self._note("replaced %d control characters in message", escape_count)
1185.12.8 by Aaron Bentley
Fixed commit so all output comes though CommitReporter
156
157
    def missing(self, path):
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
158
        self._note_change('missing %s', path)
1189 by Martin Pool
- BROKEN: partial support for commit into weave
159
1668.1.5 by Martin Pool
[broken] fix up display of files changed by a commit
160
    def renamed(self, change, old_path, new_path):
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
161
        self._note_change('%s %s => %s', change, old_path, new_path)
1668.1.5 by Martin Pool
[broken] fix up display of files changed by a commit
162
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
163
    def is_verbose(self):
164
        return True
165
1508.1.6 by Robert Collins
Move Branch.unknowns() to WorkingTree.
166
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
167
# Provide an alias
168
VerboseCommitReporter = ReportCommitToLog
169
170
1189 by Martin Pool
- BROKEN: partial support for commit into weave
171
class Commit(object):
172
    """Task of committing a new revision.
173
174
    This is a MethodObject: it accumulates state as the commit is
175
    prepared, and then it is discarded.  It doesn't represent
176
    historical revisions, just the act of recording a new one.
177
178
            missing_ids
179
            Modified to hold a list of files that have been deleted from
180
            the working directory; these should be removed from the
181
            working inventory.
485 by Martin Pool
- move commit code into its own module
182
    """
1189 by Martin Pool
- BROKEN: partial support for commit into weave
183
    def __init__(self,
1442.1.60 by Robert Collins
gpg sign commits if the policy says we need to
184
                 reporter=None,
185
                 config=None):
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
186
        """Create a Commit object.
187
188
        :param reporter: the default reporter to use or None to decide later
189
        """
190
        self.reporter = reporter
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
191
        self.config = config
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
192
 
1189 by Martin Pool
- BROKEN: partial support for commit into weave
193
    def commit(self,
2367.2.1 by Robert Collins
Remove bzrlib 0.8 compatability where it was making the code unclear or messy. (Robert Collins)
194
               message=None,
1189 by Martin Pool
- BROKEN: partial support for commit into weave
195
               timestamp=None,
196
               timezone=None,
197
               committer=None,
198
               specific_files=None,
199
               rev_id=None,
1276 by Martin Pool
- make Branch.commit accept (and ignore) verbose argument
200
               allow_pointless=True,
1185.16.65 by mbp at sourcefrog
- new commit --strict option
201
               strict=False,
1534.4.25 by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite.
202
               revprops=None,
1587.1.8 by Robert Collins
Local commits on unbound branches fail.
203
               working_tree=None,
1607.1.5 by Robert Collins
Make commit verbose mode work!.
204
               local=False,
205
               reporter=None,
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
206
               verbose=False,
2149.1.1 by Aaron Bentley
Provide a message_callback parameter to tree.commit
207
               config=None,
2255.2.218 by Robert Collins
Make the nested tree commit smoke test be more rigourous.
208
               message_callback=None,
209
               recursive='down'):
1189 by Martin Pool
- BROKEN: partial support for commit into weave
210
        """Commit working copy as a new revision.
211
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
212
        :param message: the commit message (it or message_callback is required)
213
214
        :param timestamp: if not None, seconds-since-epoch for a
215
            postdated/predated commit.
216
217
        :param specific_files: If true, commit only those files.
218
219
        :param rev_id: If set, use this as the new revision id.
1189 by Martin Pool
- BROKEN: partial support for commit into weave
220
            Useful for test or import commands that need to tightly
221
            control what revisions are assigned.  If you duplicate
222
            a revision id that exists elsewhere it is your own fault.
223
            If null (default), a time/random revision id is generated.
1253 by Martin Pool
- test that pointless commits are trapped
224
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
225
        :param allow_pointless: If true (default), commit even if nothing
1253 by Martin Pool
- test that pointless commits are trapped
226
            has changed and no merges are recorded.
1185.16.35 by Martin Pool
- stub for revision properties
227
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
228
        :param strict: If true, don't allow a commit if the working tree
1185.16.65 by mbp at sourcefrog
- new commit --strict option
229
            contains unknown files.
230
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
231
        :param revprops: Properties for new revision
1587.1.8 by Robert Collins
Local commits on unbound branches fail.
232
        :param local: Perform a local only commit.
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
233
        :param reporter: the reporter to use or None for the default
234
        :param verbose: if True and the reporter is not None, report everything
2255.2.218 by Robert Collins
Make the nested tree commit smoke test be more rigourous.
235
        :param recursive: If set to 'down', commit in any subtrees that have
236
            pending changes of any sort during this commit.
1189 by Martin Pool
- BROKEN: partial support for commit into weave
237
        """
1285 by Martin Pool
- fix bug in committing files that are renamed but not modified
238
        mutter('preparing to commit')
1189 by Martin Pool
- BROKEN: partial support for commit into weave
239
2367.2.1 by Robert Collins
Remove bzrlib 0.8 compatability where it was making the code unclear or messy. (Robert Collins)
240
        if working_tree is None:
241
            raise BzrError("working_tree must be passed into commit().")
1534.4.25 by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite.
242
        else:
243
            self.work_tree = working_tree
244
            self.branch = self.work_tree.branch
2100.3.14 by Aaron Bentley
Test workingtree4 format, prevent use with old repos
245
            if getattr(self.work_tree, 'requires_rich_root', lambda: False)():
246
                if not self.branch.repository.supports_rich_root():
247
                    raise errors.RootNotRich()
2149.1.1 by Aaron Bentley
Provide a message_callback parameter to tree.commit
248
        if message_callback is None:
2149.1.3 by Aaron Bentley
Updates from review comments
249
            if message is not None:
250
                if isinstance(message, str):
251
                    message = message.decode(bzrlib.user_encoding)
252
                message_callback = lambda x: message
2149.1.1 by Aaron Bentley
Provide a message_callback parameter to tree.commit
253
            else:
2149.1.3 by Aaron Bentley
Updates from review comments
254
                raise BzrError("The message or message_callback keyword"
255
                               " parameter is required for commit().")
1534.4.25 by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite.
256
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
257
        self.bound_branch = None
1587.1.9 by Robert Collins
Local commits do no alter or access the master branch.
258
        self.local = local
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
259
        self.master_branch = None
1614.1.1 by Aaron Bentley
Fixed master locking in commit
260
        self.master_locked = False
1740.3.10 by Jelmer Vernooij
Fix some minor issues pointed out by j-a-m.
261
        self.rev_id = None
1189 by Martin Pool
- BROKEN: partial support for commit into weave
262
        self.specific_files = specific_files
1194 by Martin Pool
- [BROKEN] more progress of commit into weaves
263
        self.allow_pointless = allow_pointless
2255.2.218 by Robert Collins
Make the nested tree commit smoke test be more rigourous.
264
        self.recursive = recursive
265
        self.revprops = revprops
266
        self.message_callback = message_callback
267
        self.timestamp = timestamp
268
        self.timezone = timezone
269
        self.committer = committer
270
        self.strict = strict
271
        self.verbose = verbose
1189 by Martin Pool
- BROKEN: partial support for commit into weave
272
2789.2.5 by Ian Clatworthy
Upgrade commit tests to reflect new reporting formats
273
        self.work_tree.lock_write()
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
274
        self.basis_tree = self.work_tree.basis_tree()
275
        self.pb = bzrlib.ui.ui_factory.nested_progress_bar()
2255.2.25 by John Arbash Meinel
DirstateRevisionTrees need to be read_locked before they will work as BasisTree
276
        self.basis_tree.lock_read()
1189 by Martin Pool
- BROKEN: partial support for commit into weave
277
        try:
1666.1.18 by Robert Collins
Add a progress bar during commit operations.
278
            # Cannot commit with conflicts present.
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
279
            if len(self.work_tree.conflicts()) > 0:
1666.1.18 by Robert Collins
Add a progress bar during commit operations.
280
                raise ConflictsInTree
281
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
282
            # Setup the bound branch variables as needed.
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
283
            self._check_bound_branch()
284
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
285
            # Check that the working tree is up to date
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
286
            old_revno, new_revno = self._check_out_of_date_tree()
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
287
2789.2.5 by Ian Clatworthy
Upgrade commit tests to reflect new reporting formats
288
            # Complete configuration setup
289
            self.initial_commit = new_revno == 1
290
            if reporter is not None:
291
                self.reporter = reporter
292
            elif self.reporter is None:
293
                self.reporter = self._select_reporter()
1587.1.6 by Robert Collins
Update bound branch implementation to 0.8.
294
            if self.config is None:
1770.2.9 by Aaron Bentley
Add Branch.get_config, update BranchConfig() callers
295
                self.config = self.branch.get_config()
1587.1.6 by Robert Collins
Update bound branch implementation to 0.8.
296
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
297
            # If provided, ensure the specified files are versioned
1551.8.29 by Aaron Bentley
Stop accepting non-existant files in commit (#50793)
298
            if specific_files is not None:
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
299
                # Note: We don't actually need the IDs here. This routine
300
                # is being called because it raises PathNotVerisonedError
301
                # as a side effect of finding the IDs.
2255.2.218 by Robert Collins
Make the nested tree commit smoke test be more rigourous.
302
                # XXX: Dont we have filter_unversioned to do this more
303
                # cheaply?
304
                tree.find_ids_across_trees(specific_files,
1551.8.29 by Aaron Bentley
Stop accepting non-existant files in commit (#50793)
305
                                           [self.basis_tree, self.work_tree])
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
306
2531.1.2 by Ian Clatworthy
Improved progress reporting for commit
307
            # Setup the progress bar. As the number of files that need to be
308
            # committed in unknown, progress is reported as stages.
309
            # We keep track of entries separately though and include that
310
            # information in the progress bar during the relevant stages.
311
            self.pb_stage_name = ""
312
            self.pb_stage_count = 0
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
313
            self.pb_stage_total = 5
2531.1.2 by Ian Clatworthy
Improved progress reporting for commit
314
            if self.bound_branch:
315
                self.pb_stage_total += 1
316
            self.pb.show_pct = False
317
            self.pb.show_spinner = False
318
            self.pb.show_eta = False
319
            self.pb.show_count = True
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
320
            self.pb.show_bar = True
1189 by Martin Pool
- BROKEN: partial support for commit into weave
321
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
322
            # After a merge, a selected file commit is not supported.
323
            # See 'bzr help merge' for an explanation as to why.
324
            self.basis_inv = self.basis_tree.inventory
1223 by Martin Pool
- store inventories in weave
325
            self._gather_parents()
1344 by Martin Pool
- disallow selected-file commit of merges
326
            if len(self.parents) > 1 and self.specific_files:
1551.15.9 by Aaron Bentley
Better error for selected-file commit of merges
327
                raise errors.CannotCommitSelectedFileMerge(self.specific_files)
1927.2.1 by Robert Collins
Alter set_pending_merges to shove the left most merge into the trees last-revision if that is not set. Related bugfixes include basis_tree handling ghosts, de-duping the merges with the last-revision and update changing where and how it adds its pending merge.
328
            
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
329
            # Collect the changes
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
330
            self._set_progress_stage("Collecting changes",
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
331
                    entries_title="Directory")
2255.2.218 by Robert Collins
Make the nested tree commit smoke test be more rigourous.
332
            self.builder = self.branch.get_commit_builder(self.parents,
1740.3.7 by Jelmer Vernooij
Move committer, log, revprops, timestamp and timezone to CommitBuilder.
333
                self.config, timestamp, timezone, committer, revprops, rev_id)
2659.3.5 by NamNguyen
merge with bzr.dev
334
            
2617.6.2 by Robert Collins
Add abort_write_group and wire write_groups into fetch and commit.
335
            try:
336
                self._update_builder_with_changes()
337
                self._check_pointless()
338
339
                # TODO: Now the new inventory is known, check for conflicts.
340
                # ADHB 2006-08-08: If this is done, populate_new_inv should not add
341
                # weave lines, because nothing should be recorded until it is known
342
                # that commit will succeed.
2617.6.9 by Robert Collins
Merge bzr.dev.
343
                self._set_progress_stage("Saving data locally")
2617.6.2 by Robert Collins
Add abort_write_group and wire write_groups into fetch and commit.
344
                self.builder.finish_inventory()
345
346
                # Prompt the user for a commit message if none provided
347
                message = message_callback(self)
348
                assert isinstance(message, unicode), type(message)
349
                self.message = message
350
                self._escape_commit_message()
351
352
                # Add revision data to the local branch
353
                self.rev_id = self.builder.commit(self.message)
2659.3.5 by NamNguyen
merge with bzr.dev
354
2617.6.2 by Robert Collins
Add abort_write_group and wire write_groups into fetch and commit.
355
            except:
2749.3.1 by Jelmer Vernooij
Add CommitBuilder.abort().
356
                self.builder.abort()
2617.6.2 by Robert Collins
Add abort_write_group and wire write_groups into fetch and commit.
357
                raise
358
2659.3.6 by NamNguyen
branch_implementations/test_commit.py:
359
            self._process_pre_hooks(old_revno, new_revno)
360
2531.1.2 by Ian Clatworthy
Improved progress reporting for commit
361
            # Upload revision data to the master.
1759.2.1 by Jelmer Vernooij
Fix some types (found using aspell).
362
            # this will propagate merged revisions too if needed.
1587.1.7 by Robert Collins
Commit revision data locally first for bound branch commits.
363
            if self.bound_branch:
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
364
                self._set_progress_stage("Uploading data to master branch")
1587.1.7 by Robert Collins
Commit revision data locally first for bound branch commits.
365
                self.master_branch.repository.fetch(self.branch.repository,
366
                                                    revision_id=self.rev_id)
367
                # now the master has the revision data
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
368
                # 'commit' to the master first so a timeout here causes the
369
                # local branch to be out of date
2230.3.51 by Aaron Bentley
Store revno for Branch6, set_last_revision -> set_last_revision_info
370
                self.master_branch.set_last_revision_info(new_revno,
371
                                                          self.rev_id)
1587.1.7 by Robert Collins
Commit revision data locally first for bound branch commits.
372
373
            # and now do the commit locally.
2230.3.51 by Aaron Bentley
Store revno for Branch6, set_last_revision -> set_last_revision_info
374
            self.branch.set_last_revision_info(new_revno, self.rev_id)
1587.1.6 by Robert Collins
Update bound branch implementation to 0.8.
375
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
376
            # Make the working tree up to date with the branch
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
377
            self._set_progress_stage("Updating the working tree")
2041.1.5 by John Arbash Meinel
CommitBuilder.get_tree => CommitBuilder.revision_tree
378
            rev_tree = self.builder.revision_tree()
2041.1.2 by John Arbash Meinel
Update WorkingTree.set_parent_trees() to directly cache inv.
379
            self.work_tree.set_parent_trees([(self.rev_id, rev_tree)])
2230.3.51 by Aaron Bentley
Store revno for Branch6, set_last_revision -> set_last_revision_info
380
            self.reporter.completed(new_revno, self.rev_id)
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
381
            self._process_post_hooks(old_revno, new_revno)
1189 by Martin Pool
- BROKEN: partial support for commit into weave
382
        finally:
1666.1.18 by Robert Collins
Add a progress bar during commit operations.
383
            self._cleanup()
1773.1.1 by Robert Collins
Teach WorkingTree.commit to return the committed revision id.
384
        return self.rev_id
1189 by Martin Pool
- BROKEN: partial support for commit into weave
385
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
386
    def _select_reporter(self):
387
        """Select the CommitReporter to use."""
388
        if is_quiet():
389
            return NullCommitReporter()
390
391
        # For the initial commit in a branch which typically adds many files,
392
        # the filenames are not printed unless verbose is explicitly asked for.
393
        # We show the total number of changes regardless.
394
        if self.initial_commit:
395
            if self.verbose:
396
                return VerboseCommitReporter(True)
397
            else:
398
                return _InitialCommitReporter(True)
399
400
        # Otherwise, the changes are shown. In verbose mode, the total number
401
        # of changes is shown as well.
402
        return VerboseCommitReporter(self.verbose)
403
2044.1.1 by Robert Collins
(Robert Collins) Forward merge from 0.11rc2 NEWS and performance-regression fix.
404
    def _any_real_changes(self):
405
        """Are there real changes between new_inventory and basis?
406
407
        For trees without rich roots, inv.root.revision changes every commit.
408
        But if that is the only change, we want to treat it as though there
409
        are *no* changes.
410
        """
411
        new_entries = self.builder.new_inventory.iter_entries()
412
        basis_entries = self.basis_inv.iter_entries()
413
        new_path, new_root_ie = new_entries.next()
414
        basis_path, basis_root_ie = basis_entries.next()
415
416
        # This is a copy of InventoryEntry.__eq__ only leaving out .revision
417
        def ie_equal_no_revision(this, other):
418
            return ((this.file_id == other.file_id)
419
                    and (this.name == other.name)
420
                    and (this.symlink_target == other.symlink_target)
421
                    and (this.text_sha1 == other.text_sha1)
422
                    and (this.text_size == other.text_size)
423
                    and (this.text_id == other.text_id)
424
                    and (this.parent_id == other.parent_id)
425
                    and (this.kind == other.kind)
426
                    and (this.executable == other.executable)
2255.2.220 by Robert Collins
Fix failing detection of changes restricted to subtrees causing spurious pointless commit errors.
427
                    and (this.reference_revision == other.reference_revision)
2044.1.1 by Robert Collins
(Robert Collins) Forward merge from 0.11rc2 NEWS and performance-regression fix.
428
                    )
429
        if not ie_equal_no_revision(new_root_ie, basis_root_ie):
430
            return True
431
432
        for new_ie, basis_ie in zip(new_entries, basis_entries):
433
            if new_ie != basis_ie:
434
                return True
435
436
        # No actual changes present
437
        return False
438
1910.2.37 by Aaron Bentley
Handle empty commits, fix test
439
    def _check_pointless(self):
440
        if self.allow_pointless:
441
            return
442
        # A merge with no effect on files
443
        if len(self.parents) > 1:
444
            return
445
        # work around the fact that a newly-initted tree does differ from its
446
        # basis
1731.1.49 by Aaron Bentley
Merge bzr.dev
447
        if len(self.basis_inv) == 0 and len(self.builder.new_inventory) == 1:
448
            raise PointlessCommit()
2044.1.1 by Robert Collins
(Robert Collins) Forward merge from 0.11rc2 NEWS and performance-regression fix.
449
        # Shortcut, if the number of entries changes, then we obviously have
450
        # a change
1910.2.37 by Aaron Bentley
Handle empty commits, fix test
451
        if len(self.builder.new_inventory) != len(self.basis_inv):
452
            return
2044.1.1 by Robert Collins
(Robert Collins) Forward merge from 0.11rc2 NEWS and performance-regression fix.
453
        # If length == 1, then we only have the root entry. Which means
454
        # that there is no real difference (only the root could be different)
455
        if (len(self.builder.new_inventory) != 1 and self._any_real_changes()):
1910.2.37 by Aaron Bentley
Handle empty commits, fix test
456
            return
457
        raise PointlessCommit()
458
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
459
    def _check_bound_branch(self):
460
        """Check to see if the local branch is bound.
461
462
        If it is bound, then most of the commit will actually be
463
        done using the remote branch as the target branch.
464
        Only at the end will the local branch be updated.
465
        """
1587.1.9 by Robert Collins
Local commits do no alter or access the master branch.
466
        if self.local and not self.branch.get_bound_location():
467
            raise errors.LocalRequiresBoundBranch()
468
469
        if not self.local:
470
            self.master_branch = self.branch.get_master_branch()
471
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
472
        if not self.master_branch:
1587.1.8 by Robert Collins
Local commits on unbound branches fail.
473
            # make this branch the reference branch for out of date checks.
474
            self.master_branch = self.branch
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
475
            return
476
477
        # If the master branch is bound, we must fail
478
        master_bound_location = self.master_branch.get_bound_location()
479
        if master_bound_location:
1505.1.27 by John Arbash Meinel
Adding tests against an sftp branch.
480
            raise errors.CommitToDoubleBoundBranch(self.branch,
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
481
                    self.master_branch, master_bound_location)
482
483
        # TODO: jam 20051230 We could automatically push local
484
        #       commits to the remote branch if they would fit.
485
        #       But for now, just require remote to be identical
486
        #       to local.
487
        
488
        # Make sure the local branch is identical to the master
2249.4.2 by Wouter van Heyst
Convert callers of Branch.revision_history() to Branch.last_revision_info() where sensible.
489
        master_info = self.master_branch.last_revision_info()
490
        local_info = self.branch.last_revision_info()
491
        if local_info != master_info:
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
492
            raise errors.BoundBranchOutOfDate(self.branch,
493
                    self.master_branch)
494
495
        # Now things are ready to change the master branch
496
        # so grab the lock
497
        self.bound_branch = self.branch
498
        self.master_branch.lock_write()
1614.1.1 by Aaron Bentley
Fixed master locking in commit
499
        self.master_locked = True
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
500
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
501
    def _check_out_of_date_tree(self):
502
        """Check that the working tree is up to date.
503
504
        :return: old_revision_number,new_revision_number tuple
505
        """
506
        try:
507
            first_tree_parent = self.work_tree.get_parent_ids()[0]
508
        except IndexError:
509
            # if there are no parents, treat our parent as 'None'
510
            # this is so that we still consider the master branch
511
            # - in a checkout scenario the tree may have no
512
            # parents but the branch may do.
513
            first_tree_parent = bzrlib.revision.NULL_REVISION
514
        old_revno, master_last = self.master_branch.last_revision_info()
515
        if master_last != first_tree_parent:
516
            if master_last != bzrlib.revision.NULL_REVISION:
517
                raise errors.OutOfDateTree(self.work_tree)
518
        if self.branch.repository.has_revision(first_tree_parent):
519
            new_revno = old_revno + 1
520
        else:
521
            # ghost parents never appear in revision history.
522
            new_revno = 1
523
        return old_revno,new_revno
524
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
525
    def _process_pre_hooks(self, old_revno, new_revno):
526
        """Process any registered pre commit hooks."""
2659.3.9 by NamNguyen
branch.py:
527
        self._set_progress_stage("Running pre_commit hooks")
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
528
        self._process_hooks("pre_commit", old_revno, new_revno)
529
530
    def _process_post_hooks(self, old_revno, new_revno):
531
        """Process any registered post commit hooks."""
2553.1.2 by Robert Collins
Show hook names during commit.
532
        # Process the post commit hooks, if any
2659.3.9 by NamNguyen
branch.py:
533
        self._set_progress_stage("Running post_commit hooks")
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
534
        # old style commit hooks - should be deprecated ? (obsoleted in
535
        # 0.15)
536
        if self.config.post_commit() is not None:
537
            hooks = self.config.post_commit().split(' ')
538
            # this would be nicer with twisted.python.reflect.namedAny
539
            for hook in hooks:
540
                result = eval(hook + '(branch, rev_id)',
541
                              {'branch':self.branch,
542
                               'bzrlib':bzrlib,
543
                               'rev_id':self.rev_id})
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
544
        # process new style post commit hooks
545
        self._process_hooks("post_commit", old_revno, new_revno)
546
547
    def _process_hooks(self, hook_name, old_revno, new_revno):
2659.3.3 by NamNguyen
Changed ``pre_commit`` hook signature.
548
        if not Branch.hooks[hook_name]:
549
            return
550
        
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
551
        # new style commit hooks:
552
        if not self.bound_branch:
553
            hook_master = self.branch
554
            hook_local = None
555
        else:
556
            hook_master = self.master_branch
557
            hook_local = self.branch
558
        # With bound branches, when the master is behind the local branch,
559
        # the 'old_revno' and old_revid values here are incorrect.
560
        # XXX: FIXME ^. RBC 20060206
561
        if self.parents:
562
            old_revid = self.parents[0]
563
        else:
564
            old_revid = bzrlib.revision.NULL_REVISION
2659.3.9 by NamNguyen
branch.py:
565
        
566
        if hook_name == "pre_commit":
567
            future_tree = self.builder.revision_tree()
568
            tree_delta = future_tree.changes_from(self.basis_tree,
569
                                             include_root=True)
570
        
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
571
        for hook in Branch.hooks[hook_name]:
2553.1.3 by Robert Collins
Increase docs in response to review feedback.
572
            # show the running hook in the progress bar. As hooks may
573
            # end up doing nothing (e.g. because they are not configured by
574
            # the user) this is still showing progress, not showing overall
575
            # actions - its up to each plugin to show a UI if it want's to
576
            # (such as 'Emailing diff to foo@example.com').
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
577
            self.pb_stage_name = "Running %s hooks [%s]" % \
2659.3.9 by NamNguyen
branch.py:
578
                (hook_name, Branch.hooks.get_hook_name(hook))
2553.1.2 by Robert Collins
Show hook names during commit.
579
            self._emit_progress()
2560.1.4 by Robert Collins
Allow -Dhooks to get the hooks invoked during commit logged.
580
            if 'hooks' in debug.debug_flags:
581
                mutter("Invoking commit hook: %r", hook)
2659.3.1 by NamNguyen
``Branch.hooks`` now supports ``pre_commit`` hook.
582
            if hook_name == "post_commit":
583
                hook(hook_local, hook_master, old_revno, old_revid, new_revno,
584
                     self.rev_id)
585
            elif hook_name == "pre_commit":
586
                hook(hook_local, hook_master,
587
                     old_revno, old_revid, new_revno, self.rev_id,
2659.3.9 by NamNguyen
branch.py:
588
                     tree_delta, future_tree)
2511.1.1 by Ian Clatworthy
commit.py clean-up including logging just to stderr, not bzr.log
589
1666.1.18 by Robert Collins
Add a progress bar during commit operations.
590
    def _cleanup(self):
591
        """Cleanup any open locks, progress bars etc."""
592
        cleanups = [self._cleanup_bound_branch,
2255.2.25 by John Arbash Meinel
DirstateRevisionTrees need to be read_locked before they will work as BasisTree
593
                    self.basis_tree.unlock,
1666.1.18 by Robert Collins
Add a progress bar during commit operations.
594
                    self.work_tree.unlock,
595
                    self.pb.finished]
596
        found_exception = None
597
        for cleanup in cleanups:
598
            try:
599
                cleanup()
600
            # we want every cleanup to run no matter what.
601
            # so we have a catchall here, but we will raise the
602
            # last encountered exception up the stack: and
603
            # typically this will be useful enough.
604
            except Exception, e:
605
                found_exception = e
606
        if found_exception is not None: 
1759.2.2 by Jelmer Vernooij
Revert some of my spelling fixes and fix some typos after review by Aaron.
607
            # don't do a plan raise, because the last exception may have been
1666.1.18 by Robert Collins
Add a progress bar during commit operations.
608
            # trashed, e is our sure-to-work exception even though it loses the
609
            # full traceback. XXX: RBC 20060421 perhaps we could check the
610
            # exc_info and if its the same one do a plain raise otherwise 
611
            # 'raise e' as we do now.
612
            raise e
613
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
614
    def _cleanup_bound_branch(self):
615
        """Executed at the end of a try/finally to cleanup a bound branch.
616
617
        If the branch wasn't bound, this is a no-op.
618
        If it was, it resents self.branch to the local branch, instead
619
        of being the master.
620
        """
621
        if not self.bound_branch:
622
            return
1614.1.1 by Aaron Bentley
Fixed master locking in commit
623
        if self.master_locked:
624
            self.master_branch.unlock()
1505.1.24 by John Arbash Meinel
Updated commit to handle bound branches. Included test to handle commit after merge
625
1390 by Robert Collins
pair programming worx... merge integration and weave
626
    def _escape_commit_message(self):
627
        """Replace xml-incompatible control characters."""
1666.1.6 by Robert Collins
Make knit the default format.
628
        # FIXME: RBC 20060419 this should be done by the revision
629
        # serialiser not by commit. Then we can also add an unescaper
630
        # in the deserializer and start roundtripping revision messages
631
        # precisely. See repository_implementations/test_repository.py
632
        
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
633
        # Python strings can include characters that can't be
634
        # represented in well-formed XML; escape characters that
635
        # aren't listed in the XML specification
636
        # (http://www.w3.org/TR/REC-xml/#NT-Char).
1390 by Robert Collins
pair programming worx... merge integration and weave
637
        self.message, escape_count = re.subn(
1393.4.2 by Harald Meland
Cleanup + better test of commit-msg control character escape code.
638
            u'[^\x09\x0A\x0D\u0020-\uD7FF\uE000-\uFFFD]+',
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
639
            lambda match: match.group(0).encode('unicode_escape'),
1390 by Robert Collins
pair programming worx... merge integration and weave
640
            self.message)
1185.11.5 by John Arbash Meinel
Merged up-to-date against mainline, still broken.
641
        if escape_count:
1185.12.8 by Aaron Bentley
Fixed commit so all output comes though CommitReporter
642
            self.reporter.escaped(escape_count, self.message)
1223 by Martin Pool
- store inventories in weave
643
644
    def _gather_parents(self):
1092.2.25 by Robert Collins
support ghosts in commits
645
        """Record the parents of a merge for merge detection."""
1740.3.6 by Jelmer Vernooij
Move inventory writing to the commit builder.
646
        # TODO: Make sure that this list doesn't contain duplicate 
647
        # entries and the order is preserved when doing this.
1773.2.1 by Robert Collins
Teach all trees about unknowns, conflicts and get_parent_ids.
648
        self.parents = self.work_tree.get_parent_ids()
2283.2.1 by John Arbash Meinel
Avoid deserializing an inventory we have already parsed.
649
        self.parent_invs = [self.basis_inv]
650
        for revision in self.parents[1:]:
1185.67.2 by Aaron Bentley
Renamed Branch.storage to Branch.repository
651
            if self.branch.repository.has_revision(revision):
1927.2.1 by Robert Collins
Alter set_pending_merges to shove the left most merge into the trees last-revision if that is not set. Related bugfixes include basis_tree handling ghosts, de-duping the merges with the last-revision and update changing where and how it adds its pending merge.
652
                mutter('commit parent revision {%s}', revision)
1185.67.2 by Aaron Bentley
Renamed Branch.storage to Branch.repository
653
                inventory = self.branch.repository.get_inventory(revision)
1185.65.1 by Aaron Bentley
Refactored out ControlFiles and RevisionStore from _Branch
654
                self.parent_invs.append(inventory)
1927.2.1 by Robert Collins
Alter set_pending_merges to shove the left most merge into the trees last-revision if that is not set. Related bugfixes include basis_tree handling ghosts, de-duping the merges with the last-revision and update changing where and how it adds its pending merge.
655
            else:
656
                mutter('commit parent ghost revision {%s}', revision)
1284 by Martin Pool
- in commit, avoid reading basis inventory twice
657
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
658
    def _update_builder_with_changes(self):
659
        """Update the commit builder with the data about what has changed.
660
        """
661
        # Build the revision inventory.
662
        #
663
        # This starts by creating a new empty inventory. Depending on
664
        # which files are selected for commit, and what is present in the
665
        # current tree, the new inventory is populated. inventory entries 
666
        # which are candidates for modification have their revision set to
667
        # None; inventory entries that are carried over untouched have their
668
        # revision set to their prior value.
669
        #
1551.7.24 by Aaron Bentley
Ensure commit respects file spec when committing removals
670
        # ESEPARATIONOFCONCERNS: this function is diffing and using the diff
671
        # results to create a new inventory at the same time, which results
1852.10.3 by Robert Collins
Remove all uses of compare_trees and replace with Tree.changes_from throughout bzrlib.
672
        # in bugs like #46635.  Any reason not to use/enhance Tree.changes_from?
1551.7.24 by Aaron Bentley
Ensure commit respects file spec when committing removals
673
        # ADHB 11-07-2006
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
674
675
        specific_files = self.specific_files
676
        mutter("Selecting files for commit with filter %s", specific_files)
677
678
        # Check and warn about old CommitBuilders
2564.2.7 by Ian Clatworthy
Clean-up comments and make use of self.builder.record_root_entry more explicit
679
        if not self.builder.record_root_entry:
1910.2.9 by Aaron Bentley
Inroduce assertDeprecated, and use it to test old commitbuilder API
680
            symbol_versioning.warn('CommitBuilders should support recording'
681
                ' the root entry as of bzr 0.10.', DeprecationWarning, 
682
                stacklevel=1)
1910.2.4 by Aaron Bentley
Support old CommitBuilders
683
            self.builder.new_inventory.add(self.basis_inv.root.copy())
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
684
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
685
        # Build the new inventory
2564.2.7 by Ian Clatworthy
Clean-up comments and make use of self.builder.record_root_entry more explicit
686
        self._populate_from_inventory(specific_files)
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
687
2564.2.7 by Ian Clatworthy
Clean-up comments and make use of self.builder.record_root_entry more explicit
688
        # If specific files are selected, then all un-selected files must be
689
        # recorded in their previous state. For more details, see
690
        # https://lists.ubuntu.com/archives/bazaar/2007q3/028476.html.
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
691
        if specific_files:
692
            for path, new_ie in self.basis_inv.iter_entries():
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
693
                if new_ie.file_id in self.builder.new_inventory:
2541.1.1 by Ian Clatworthy
Refactor commit.commit() to walk the working inventory once/less
694
                    continue
695
                if is_inside_any(specific_files, path):
696
                    continue
697
                ie = new_ie.copy()
698
                ie.revision = None
699
                self.builder.record_entry_contents(ie, self.parent_invs, path,
700
                                                   self.basis_tree)
701
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
702
        # Report what was deleted.
703
        if self.reporter.is_verbose():
704
            for path, ie in self.basis_inv.iter_entries():
705
                if ie.file_id not in self.builder.new_inventory:
706
                    self.reporter.deleted(path)
1551.7.24 by Aaron Bentley
Ensure commit respects file spec when committing removals
707
2564.2.7 by Ian Clatworthy
Clean-up comments and make use of self.builder.record_root_entry more explicit
708
    def _populate_from_inventory(self, specific_files):
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
709
        """Populate the CommitBuilder by walking the working tree inventory."""
710
        if self.strict:
711
            # raise an exception as soon as we find a single unknown.
712
            for unknown in self.work_tree.unknowns():
713
                raise StrictCommitFailed()
714
               
715
        deleted_ids = []
716
        deleted_paths = set()
717
        work_inv = self.work_tree.inventory
718
        assert work_inv.root is not None
719
        entries = work_inv.iter_entries()
2564.2.7 by Ian Clatworthy
Clean-up comments and make use of self.builder.record_root_entry more explicit
720
        if not self.builder.record_root_entry:
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
721
            entries.next()
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
722
        report_changes = self.reporter.is_verbose()
2564.2.6 by Ian Clatworthy
Incorporate feedback from abentley
723
        for path, existing_ie in entries:
724
            file_id = existing_ie.file_id
725
            name = existing_ie.name
726
            parent_id = existing_ie.parent_id
727
            kind = existing_ie.kind
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
728
            if kind == 'directory':
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
729
                self._next_progress_entry()
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
730
731
            # Skip files that have been deleted from the working tree.
732
            # The deleted files/directories are also recorded so they
733
            # can be explicitly unversioned later. Note that when a
734
            # filter of specific files is given, we must only skip/record
735
            # deleted files matching that filter.
736
            if is_inside_any(deleted_paths, path):
737
                continue
738
            if not specific_files or is_inside_any(specific_files, path):
739
                if not self.work_tree.has_filename(path):
740
                    deleted_paths.add(path)
741
                    self.reporter.missing(path)
742
                    deleted_ids.append(file_id)
743
                    continue
744
            try:
745
                kind = self.work_tree.kind(file_id)
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
746
                # TODO: specific_files filtering before nested tree processing
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
747
                if kind == 'tree-reference' and self.recursive == 'down':
2564.2.3 by Ian Clatworthy
more abentley feedback: use get_nested_tree and include file_id
748
                    self._commit_nested_tree(file_id, path)
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
749
            except errors.NoSuchFile:
750
                pass
751
752
            # Record an entry for this item
753
            # Note: I don't particularly want to have the existing_ie
754
            # parameter but the test suite currently (28-Jun-07) breaks
755
            # without it thanks to a unicode normalisation issue. :-(
2564.2.6 by Ian Clatworthy
Incorporate feedback from abentley
756
            definitely_changed = kind != existing_ie.kind 
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
757
            self._record_entry(path, file_id, specific_files, kind, name,
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
758
                parent_id, definitely_changed, existing_ie, report_changes)
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
759
760
        # Unversion IDs that were found to be deleted
761
        self.work_tree.unversion(deleted_ids)
762
2564.2.3 by Ian Clatworthy
more abentley feedback: use get_nested_tree and include file_id
763
    def _commit_nested_tree(self, file_id, path):
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
764
        "Commit a nested tree."
2564.2.3 by Ian Clatworthy
more abentley feedback: use get_nested_tree and include file_id
765
        sub_tree = self.work_tree.get_nested_tree(file_id, path)
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
766
        # FIXME: be more comprehensive here:
767
        # this works when both trees are in --trees repository,
768
        # but when both are bound to a different repository,
769
        # it fails; a better way of approaching this is to 
770
        # finally implement the explicit-caches approach design
771
        # a while back - RBC 20070306.
2665.5.2 by Aaron Bentley
Switch commit and merge to Repository.has_same_location
772
        if sub_tree.branch.repository.has_same_location(
773
            self.work_tree.branch.repository):
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
774
            sub_tree.branch.repository = \
775
                self.work_tree.branch.repository
776
        try:
777
            sub_tree.commit(message=None, revprops=self.revprops,
778
                recursive=self.recursive,
779
                message_callback=self.message_callback,
780
                timestamp=self.timestamp, timezone=self.timezone,
781
                committer=self.committer,
782
                allow_pointless=self.allow_pointless,
783
                strict=self.strict, verbose=self.verbose,
784
                local=self.local, reporter=self.reporter)
785
        except errors.PointlessCommit:
786
            pass
787
788
    def _record_entry(self, path, file_id, specific_files, kind, name,
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
789
                      parent_id, definitely_changed, existing_ie=None,
790
                      report_changes=False):
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
791
        "Record the new inventory entry for a path if any."
792
        # mutter('check %s {%s}', path, file_id)
793
        if (not specific_files or 
794
            is_inside_or_parent_of_any(specific_files, path)):
795
                # mutter('%s selected for commit', path)
796
                if definitely_changed or existing_ie is None:
797
                    ie = inventory.make_entry(kind, name, parent_id, file_id)
798
                else:
799
                    ie = existing_ie.copy()
800
                    ie.revision = None
801
        else:
802
            # mutter('%s not selected for commit', path)
803
            if self.basis_inv.has_id(file_id):
804
                ie = self.basis_inv[file_id].copy()
805
            else:
806
                # this entry is new and not being committed
807
                ie = None
808
        if ie is not None:
809
            self.builder.record_entry_contents(ie, self.parent_invs, 
810
                path, self.work_tree)
2789.2.4 by Ian Clatworthy
make change reporting smarter for initial commit
811
812
            # Special case initial commit for performance and UI reasons
813
            if self.initial_commit:
814
                self.reporter.snapshot_change('added', path)
815
            elif report_changes:
2789.2.1 by Ian Clatworthy
Make commit less verbose by default
816
                self._report_change(ie, path)
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
817
        return ie
818
819
    def _report_change(self, ie, path):
820
        """Report a change to the user.
821
822
        The change that has occurred is described relative to the basis
823
        inventory.
824
        """
825
        if (self.basis_inv.has_id(ie.file_id)):
826
            basis_ie = self.basis_inv[ie.file_id]
827
        else:
828
            basis_ie = None
829
        change = ie.describe_change(basis_ie, ie)
830
        if change in (InventoryEntry.RENAMED, 
831
            InventoryEntry.MODIFIED_AND_RENAMED):
832
            old_path = self.basis_inv.id2path(ie.file_id)
833
            self.reporter.renamed(change, old_path, path)
834
        else:
835
            self.reporter.snapshot_change(change, path)
836
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
837
    def _set_progress_stage(self, name, entries_title=None):
2531.1.2 by Ian Clatworthy
Improved progress reporting for commit
838
        """Set the progress stage and emit an update to the progress bar."""
839
        self.pb_stage_name = name
840
        self.pb_stage_count += 1
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
841
        self.pb_entries_title = entries_title
842
        if entries_title is not None:
2531.1.2 by Ian Clatworthy
Improved progress reporting for commit
843
            self.pb_entries_count = 0
844
            self.pb_entries_total = '?'
845
        self._emit_progress()
846
2564.2.2 by Ian Clatworthy
incorporate feedback from abentley
847
    def _next_progress_entry(self):
848
        """Emit an update to the progress bar and increment the entry count."""
2531.1.2 by Ian Clatworthy
Improved progress reporting for commit
849
        self.pb_entries_count += 1
850
        self._emit_progress()
851
852
    def _emit_progress(self):
2564.2.1 by Ian Clatworthy
refactor commit to support alternative population meothds
853
        if self.pb_entries_title:
854
            if self.pb_entries_total == '?':
855
                text = "%s [%s %d] - Stage" % (self.pb_stage_name,
856
                    self.pb_entries_title, self.pb_entries_count)
857
            else:
858
                text = "%s [%s %d/%s] - Stage" % (self.pb_stage_name,
859
                    self.pb_entries_title, self.pb_entries_count,
860
                    str(self.pb_entries_total))
2531.1.2 by Ian Clatworthy
Improved progress reporting for commit
861
        else:
862
            text = "%s - Stage" % (self.pb_stage_name)
863
        self.pb.update(text, self.pb_stage_count, self.pb_stage_total)
864