/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
932 by Martin Pool
- more diff TODOs
1
.. -*- mode: indented-text; compile-command: "make -C doc" -*-
321 by Martin Pool
doc: revfile storage and related things
2
3
4
*******************
5
Things to do in bzr
6
*******************
7
287 by Martin Pool
- todo: plugins
8
293 by Martin Pool
- todos
9
See also various low-level TODOs in the source code.  Try looking in
284 by Martin Pool
- more TODO items
10
the list archive or on gmane.org for previous discussion of these
293 by Martin Pool
- todos
11
issues.
12
13
These are classified by approximate size: an hour or less, a day or
14
less, and several days or more.
15
282 by Martin Pool
- move all TODO items into ./TODO
16
17
Small things
18
------------
19
985 by Martin Pool
- update todo list
20
* print a message at the end of running the tests telling them tht the
21
  test log and output exists but can be removed
975 by Martin Pool
- more checks for some operations in subdirectories
22
23
* tests for running the commit editor, and fix problem of not passing in 
24
  multiple arguments
25
852 by Martin Pool
todo
26
* Merging add of a new file clashing with an existing file doesn't
27
  work; add gets an error that it's already versioned and the merge
932 by Martin Pool
- more diff TODOs
28
  aborts.
852 by Martin Pool
todo
29
850 by Martin Pool
- Merge merge updates from aaron
30
* Merge should ignore the destination's working directory, otherwise
31
  we get an error about the statcache when pulling from a remote
32
  branch.
33
282 by Martin Pool
- move all TODO items into ./TODO
34
* Add of a file that was present in the base revision should put back
35
  the previous file-id.
36
914 by Martin Pool
- fix up breakage of 'bzr log -v' by root_id patch
37
* Not sure I'm happy with needing to pass a root id to EmptyTree;
38
  comparing anything against an EmptyTree with no root should have the
39
  same effect(?)
40
282 by Martin Pool
- move all TODO items into ./TODO
41
* Handle diff of files which do not have a trailing newline; probably
42
  requires patching difflib to get it exactly right, or otherwise
43
  calling out to GNU diff.
44
902 by Martin Pool
todo
45
* Should be able to copy files between branches to preserve their
46
  file-id (and perhaps eventually parentage.)
47
289 by Martin Pool
todo
48
* -r option should take a revision-id as well as a revno.
49
903 by Martin Pool
todo
50
* allow ``bzr st -r 300`` to show a summary of changes since then.
51
322 by Martin Pool
- update todo list
52
* ``bzr info`` should count only people with distinct email addresses as
290 by Martin Pool
todo
53
  different committers.  (Or perhaps only distinct userids?)
54
322 by Martin Pool
- update todo list
55
* On Windows, command-line arguments should be `glob-expanded`__,
293 by Martin Pool
- todos
56
  because the shell doesn't do this.  However, there are probably some
57
  commands where this shouldn't be done, such as 'bzr ignore', because
58
  we want to accept globs.
59
329 by Martin Pool
- refactor command functions into command classes
60
* ``bzr ignore`` command that just adds a line to the ``.bzrignore`` file
61
  and makes it versioned.  Fix this to break symlinks.
295 by Martin Pool
todo
62
312 by Martin Pool
todo
63
* Any useful sanity checks in 'bzr ignore'?  Perhaps give a warning if
64
  they try to add a single file which is already versioned, or if they
65
  add a pattern which already exists, or if it looks like they gave an
66
  unquoted glob.
310 by Martin Pool
- new 'bzr ignored' command!
67
325 by Martin Pool
- more revfile design notes
68
__ http://mail.python.org/pipermail/python-list/2001-April/037847.html
69
327 by Martin Pool
todo
70
* Separate read and write version checks?
325 by Martin Pool
- more revfile design notes
71
405 by Martin Pool
todo
72
* ``bzr status DIR`` should give status on all files under that
73
  directory.
74
484 by Martin Pool
todo
75
* ``bzr log DIR`` should give changes to any files within DIR.
76
329 by Martin Pool
- refactor command functions into command classes
77
* ``bzr inventory -r REV`` and perhaps unify this with ``bzr ls``,
78
  giving options to display ids, types, etc.
79
341 by Martin Pool
todo
80
* Split BzrError into various more specific subclasses for different
81
  errors people might want to catch.
326 by Martin Pool
todo
82
393 by Martin Pool
todo: export to tarball
83
* If the export destination ends in '.tar', '.tar.gz', etc then create
84
  a tarball instead of a directory.  (Need to actually make a
85
  temporary directory and then tar that up.)
86
87
  http://www.gelato.unsw.edu.au/archives/git/0504/2194.html
932 by Martin Pool
- more diff TODOs
88
414 by Martin Pool
todo
89
* RemoteBranch could maintain a cache either in memory or on disk.  We
90
  know more than an external cache might about which files are
91
  immutable and which can vary.  On the other hand, it's much simpler
92
  to just use an external proxy cache.
93
586 by Martin Pool
todo
94
  Perhaps ~/.bzr/http-cache.  Baz has a fairly simple cache under
95
  ~/.arch-cache, containing revision information encoded almost as a
96
  bunch of archives.  Perhaps we could simply store full paths.
97
487 by Martin Pool
todo
98
* Maybe also store directories in the statcache so that we can quickly
99
  identify that they still exist.
100
570 by Martin Pool
doc
101
* Diff should show timestamps; for files from the working directory we
102
  can use the file itself; for files from a revision we should use the
103
  commit time of the revision.
104
593 by Martin Pool
todo
105
* Perhaps split command infrastructure from the actual command
106
  definitions.
107
108
* Cleaner support for negative boolean options like --no-recurse.
109
603 by Martin Pool
doc
110
* Statcache should possibly map all file paths to / separators
111
642 by Martin Pool
- notes on patches for Windows
112
* quotefn doubles all backslashes on Windows; this is probably not the
113
  best thing to do.  What would be a better way to safely represent
114
  filenames?  Perhaps we could doublequote things containing spaces,
115
  on the principle that filenames containing quotes are unlikely?
116
  Nice for humans; less good for machine parsing.
117
118
* Patches should probably use only forward slashes, even on Windows,
932 by Martin Pool
- more diff TODOs
119
  otherwise Unix patch can't apply them. (?)
642 by Martin Pool
- notes on patches for Windows
120
665 by Martin Pool
todo
121
* Branch.update_revisions() inefficiently fetches revisions from the
122
  remote server twice; once to find out what text and inventory they
123
  need and then again to actually get the thing.  This is a bit
932 by Martin Pool
- more diff TODOs
124
  inefficient.
665 by Martin Pool
todo
125
126
  One complicating factor here is that we don't really want to have
127
  revisions present in the revision-store until all their constituent
128
  parts are also stored.
129
130
  The basic problem is that RemoteBranch.get_revision() and similar
131
  methods return object, but what we really want is the raw XML, which
132
  can be popped into our own store.  That needs to be refactored.
691 by Martin Pool
todo
133
134
* ``bzr status FOO`` where foo is ignored should say so.
724 by Martin Pool
- todo: bzr mkdir
135
136
* ``bzr mkdir A...`` should just create and add A.
818 by Martin Pool
- Clear pending-merge list when committing.
137
138
* Guard against repeatedly merging any particular patch.
932 by Martin Pool
- more diff TODOs
139
140
* More options for diff:
141
142
  - diff two revisions of the same tree
143
144
  - diff two different branches, optionally at different revisions
145
146
  - diff a particular file in another tree against the corresponding
147
    version in this tree (which should be the default if the second
148
    parameter is a tree root)
149
150
  - diff everything under a particular directory, in any of the above
151
    ways
152
153
  - diff two files inside the same tree, even if they have different
154
    ids
155
156
  - and, of course, tests for all this
157
960 by Martin Pool
todo
158
* ``bzr add`` with no arguments should probably be the same as ``bzr add .``
932 by Martin Pool
- more diff TODOs
159
967 by Martin Pool
todo
160
* Reproducible performance benchmark to measure whether performance is 
161
  getting better or worse.
665 by Martin Pool
todo
162
414 by Martin Pool
todo
163
282 by Martin Pool
- move all TODO items into ./TODO
164
Medium things
165
-------------
166
167
* Merge revert patch.
168
329 by Martin Pool
- refactor command functions into command classes
169
* ``bzr mv`` that does either rename or move as in Unix.
282 by Martin Pool
- move all TODO items into ./TODO
170
478 by Martin Pool
- put back support for running diff or status on
171
* More efficient diff of only selected files.  We should be able to
172
  just get the id for the selected files, look up their location and
173
  diff just those files.  No need to traverse the entire inventories.
282 by Martin Pool
- move all TODO items into ./TODO
174
479 by Martin Pool
todo
175
* ``bzr status DIR`` or ``bzr diff DIR`` should report on all changes
176
  under that directory.
177
282 by Martin Pool
- move all TODO items into ./TODO
178
* Fix up Inventory objects to represent root object as an entry.
179
552 by Martin Pool
- update todo list
180
* Don't convert entire entry from ElementTree to an object when it is
181
  read in, but rather wait until the program actually wants to know
182
  about that node.
282 by Martin Pool
- move all TODO items into ./TODO
183
184
* Extract changes from one revision to the next to a text form
185
  suitable for transmission over email.
186
187
* More test cases.
188
491 by Martin Pool
- Selective commit!
189
  - Selected-file commit
190
191
  - Impossible selected-file commit: adding things in non-versioned
192
    directories, crossing renames, etc.
193
282 by Martin Pool
- move all TODO items into ./TODO
194
* Write a reproducible benchmark, perhaps importing various kernel versions.
195
196
* Directly import diffs!  It seems a bit redundant to need to rescan
197
  the directory to work out what files diff added/deleted/changed when
198
  all the information is there in the diff in the first place.
199
  Getting the exact behaviour for added/deleted subdirectories etc
200
  might be hard.
201
202
  At the very least we could run diffstat over the diff, or perhaps
203
  read the status output from patch.  Just knowing which files might
204
  be modified would be enough to guide the add and commit.
932 by Martin Pool
- more diff TODOs
205
282 by Martin Pool
- move all TODO items into ./TODO
206
  Given this we might be able to import patches at 1/second or better.
207
208
* Get branch over http.
209
210
* Pull pure updates over http.
211
212
* revfile compression.
213
214
* Split inventory into per-directory files.
215
284 by Martin Pool
- more TODO items
216
* Fix ignore file parsing:
217
218
  - fnmatch is not the same as unix patterns
219
220
  - perhaps add extended globs from rsh/rsync
221
222
  - perhaps a pattern that matches only directories or non-directories
223
312 by Martin Pool
todo
224
* Consider using Python logging library as well as/instead of
225
  bzrlib.trace.
226
334 by Martin Pool
doc
227
* Commands should give some progress indication by default.
228
229
  - But quieten this with ``--silent``.
230
312 by Martin Pool
todo
231
* Change to using gettext message localization.
282 by Martin Pool
- move all TODO items into ./TODO
232
315 by Martin Pool
todo
233
* Make a clearer separation between internal and external bzrlib
234
  interfaces.  Make internal interfaces use protected names.  Write at
235
  least some documentation for those APIs, probably as docstrings.
236
237
  Consider using ZopeInterface definitions for the external interface;
238
  I think these are already used in PyBaz.  They allow automatic
239
  checking of the interface but may be unfamiliar to general Python
321 by Martin Pool
doc: revfile storage and related things
240
  developers, so I'm not really keen.
315 by Martin Pool
todo
241
242
* Commands to dump out all command help into a manpage or HTML file or
243
  whatever.
244
326 by Martin Pool
todo
245
* Handle symlinks in the working directory; at the very least it
246
  should be possible for them to be present and ignored/unknown
932 by Martin Pool
- more diff TODOs
247
  without causing assertion failures.
326 by Martin Pool
todo
248
249
  Eventually symlinks should be versioned.
250
329 by Martin Pool
- refactor command functions into command classes
251
* Allow init in a subdirectory to create a nested repository, but only
252
  if the subdirectory is not already versioned.   Perhaps also require
253
  a ``--nested`` to protect against confusion.
254
932 by Martin Pool
- more diff TODOs
255
* Branch names?
329 by Martin Pool
- refactor command functions into command classes
256
339 by Martin Pool
many more diffs
257
* More test framework:
258
259
  - Class that describes the state of a working tree so we can just
260
    assert it's equal.
261
342 by Martin Pool
todo
262
* There are too many methods on Branch() that really manipulate the
932 by Martin Pool
- more diff TODOs
263
  WorkingTree.  They should be moved across.
346 by Martin Pool
todo
264
265
  Also there are some methods which are duplicated on Tree and
266
  Inventory objects, and it should be made more clear which ones are
267
  proxies and which ones behave differently, and how.
342 by Martin Pool
todo
268
361 by Martin Pool
todo
269
* Try using XSLT to add some formatting to REST-generated HTML.  Or
270
  maybe write a small Python program that specifies a header and foot
271
  for the pages and calls into the docutils libraries.
272
366 by Martin Pool
todo
273
* --format=xml for log, status and other commands.
329 by Martin Pool
- refactor command functions into command classes
274
370 by Martin Pool
todo
275
* Attempting to explicitly add a file that's already added should give
276
  a warning; however there should be no warning for directories (since
277
  we scan for new children) or files encountered in a directory that's
278
  being scanned.
329 by Martin Pool
- refactor command functions into command classes
279
377 by Martin Pool
- todo notes on inventory
280
* Better handling of possible collisions on case-losing filesystems;
281
  make sure a single file does not get added twice under different
282
  names.
283
284
* Clean up XML inventory:
285
286
  - Use nesting rather than parent_id pointers.
287
288
  - Hold the ElementTree in memory in the Inventory object and work
289
    directly on that, rather than converting into Python objects every
453 by Martin Pool
- Split WorkingTree into its own file
290
    time it is read in.  Probably still exposoe it through some kind of
377 by Martin Pool
- todo notes on inventory
291
    object interface though, but perhaps that should just be a proxy
292
    for the elements.
293
932 by Martin Pool
- more diff TODOs
294
  - Less special cases for the root directory.
377 by Martin Pool
- todo notes on inventory
295
388 by Martin Pool
doc
296
* Perhaps inventories should remember the revision in which each file
297
  was last changed, as well as its current state?  This is a bit
298
  redundant but might often be interested to know.
299
442 by Martin Pool
todo
300
* stat cache should perhaps only stat files as necessary, rather than
301
  doing them all up-front.  On the other hand, that disallows the
302
  opimization of stating them in inode order.
303
451 by Martin Pool
todo
304
* It'd be nice to pipeline multiple HTTP requests.  Often we can
305
  predict what will be wanted in future: all revisions, or all texts
932 by Martin Pool
- more diff TODOs
306
  in a particular revision, etc.
451 by Martin Pool
todo
307
308
  urlgrabber's docs say they are working on batched downloads; we
309
  could perhaps ride on that or just create a background thread (ew).
310
459 by Martin Pool
- diff now uses stat-cache -- much faster
311
* Paranoid mode where we never trust SHA-1 matches.
312
502 by Martin Pool
todo
313
* Don't commit if there are no changes unless forced.
314
522 by Martin Pool
todo
315
* --dry-run mode for commit?  (Or maybe just run with
316
  check-command=false?)
502 by Martin Pool
todo
317
318
* Generally, be a bit more verbose unless --silent is specified.
319
522 by Martin Pool
todo
320
* Function that finds all changes to files under a given directory;
321
  perhaps log should use this if a directory is given.
322
548 by Martin Pool
- Write statcache using \u style encoding to avoid
323
* XML attributes might have trouble with filenames containing \n and
324
  \r.  Do we really want to support this?  I think perhaps not.
325
574 by Martin Pool
todo
326
* Remember execute bits, so that exports will work OK.
327
579 by Martin Pool
todo
328
* Unify smart_add and plain Branch.add(); perhaps smart_add should
329
  just build a list of files to add and pass that to the regular add
330
  function.
331
604 by Martin Pool
doc
332
* Function to list a directory, saying in which revision each file was
333
  last modified.  Useful for web and gui interfaces, and slow to
334
  compute one file at a time.
335
609 by Martin Pool
- cleanup test code
336
* unittest is standard, but the results are kind of ugly; would be
337
  nice to make it cleaner.
338
627 by Martin Pool
todo
339
* Check locking is correct during merge-related operations.
340
629 by Martin Pool
todo
341
* Perhaps attempts to get locks should timeout after some period of
342
  time, or at least display a progress message.
343
702 by Martin Pool
todo: bzr upgrade
344
* Split out upgrade functionality from check command into a separate
345
  ``bzr upgrade``.
346
738 by Martin Pool
- default plugin dir is ~/.bzr.conf/plugins
347
* Don't pass around command classes but rather pass objects.  This'd
348
  make it cleaner to construct objects wrapping external commands.
349
818 by Martin Pool
- Clear pending-merge list when committing.
350
* Track all merged-in revisions in a versioned add-only metafile.
351
315 by Martin Pool
todo
352
282 by Martin Pool
- move all TODO items into ./TODO
353
Large things
354
------------
355
321 by Martin Pool
doc: revfile storage and related things
356
* Generate annotations from current file relative to previous
357
  annotations.
358
359
  - Is it necessary to store any kind of annotation where data was
360
    deleted?
361
325 by Martin Pool
- more revfile design notes
362
* Update revfile_ format and make it active:
321 by Martin Pool
doc: revfile storage and related things
363
364
  - Texts should be identified by something keyed on the revision, not
365
    an individual text-id.  This is much more useful for annotate I
366
    think; we want to map back to the revision that last changed it.
367
368
  - Access revfile revisions through the Tree/Store classes.
369
370
  - Check them from check commands.
371
372
  - Store annotations.
373
325 by Martin Pool
- more revfile design notes
374
.. _revfile: revfile.html
375
294 by Martin Pool
todo
376
* Hooks for pre-commit, post-commit, etc.
377
378
  Consider the security implications; probably should not enable hooks
379
  for remotely-fetched branches by default.
380
381
* Pre-commit check.  If this hook is defined, it needs to be handled
382
  specially: create a temporary directory containing the tree as it
383
  will be after the commit.  This means excluding any ignored/unknown
384
  files, and respecting selective commits.  Run the pre-commit check
385
  (e.g. compile and run test suite) in there.
386
519 by Martin Pool
- todo: discussion of pre-commit tests
387
  Possibly this should be done by splitting the commit function into
388
  several parts (under a single interface).  It is already rather
389
  large.  Decomposition:
390
391
   - find tree modifications and prepare in-memory inventory
392
393
   - export that inventory to a temporary directory
394
395
   - run the test in that temporary directory
396
397
   - if that succeeded, continue to actually finish the commit
398
399
  What should be done with the text of modified files while this is
400
  underway?  I don't think we want to count on holding them in memory
401
  and we can't trust the working files to stay in one place so I
402
  suppose we need to move them into the text store, or otherwise into
403
  a temporary directory.
404
405
  If the commit does not actually complete, we would rather the
932 by Martin Pool
- more diff TODOs
406
  content was not left behind in the stores.
519 by Martin Pool
- todo: discussion of pre-commit tests
407
282 by Martin Pool
- move all TODO items into ./TODO
408
* Web interface
409
410
* GUI (maybe in Python GTK+?)
411
284 by Martin Pool
- more TODO items
412
* C library interface
321 by Martin Pool
doc: revfile storage and related things
413
414
* Expansion of $Id$ keywords within working files.  Perhaps do this in
415
  exports first as a simpler case because then we don't need to deal
416
  with removing the tags on the way back in.
417
329 by Martin Pool
- refactor command functions into command classes
418
* ``bzr find``