/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
325 by Martin Pool
- more revfile design notes
1
.. -*- mode: indented-text; compile-command: "make -C doc" -*- 
321 by Martin Pool
doc: revfile storage and related things
2
3
4
*******************
5
Things to do in bzr
6
*******************
7
287 by Martin Pool
- todo: plugins
8
293 by Martin Pool
- todos
9
See also various low-level TODOs in the source code.  Try looking in
284 by Martin Pool
- more TODO items
10
the list archive or on gmane.org for previous discussion of these
293 by Martin Pool
- todos
11
issues.
12
13
These are classified by approximate size: an hour or less, a day or
14
less, and several days or more.
15
282 by Martin Pool
- move all TODO items into ./TODO
16
17
Small things
18
------------
19
20
* Add of a file that was present in the base revision should put back
21
  the previous file-id.
22
23
* Handle diff of files which do not have a trailing newline; probably
24
  requires patching difflib to get it exactly right, or otherwise
25
  calling out to GNU diff.
26
27
* Import ElementTree update patch.
28
287 by Martin Pool
- todo: plugins
29
* Plugins that provide commands.  By just installing a file into some
322 by Martin Pool
- update todo list
30
  directory (e.g. ``/usr/share/bzr/plugins``) it should be possible to
31
  create new top-level commands (``bzr frob``).  Extensions can be
287 by Martin Pool
- todo: plugins
32
  written in either Python (in which case they use the bzrlib API) or
33
  in a separate process (in sh, C, whatever).   It should be possible
34
  to get help for plugin commands.
35
288 by Martin Pool
TODO
36
* Smart rewrap text in help messages to fit in $COLUMNS (or equivalent
37
  on Windows)
38
289 by Martin Pool
todo
39
* -r option should take a revision-id as well as a revno.
40
322 by Martin Pool
- update todo list
41
* ``bzr info`` could show space used by working tree, versioned files,
290 by Martin Pool
todo
42
  unknown and ignored files. 
43
322 by Martin Pool
- update todo list
44
* ``bzr info`` should count only people with distinct email addresses as
290 by Martin Pool
todo
45
  different committers.  (Or perhaps only distinct userids?)
46
322 by Martin Pool
- update todo list
47
* On Windows, command-line arguments should be `glob-expanded`__,
293 by Martin Pool
- todos
48
  because the shell doesn't do this.  However, there are probably some
49
  commands where this shouldn't be done, such as 'bzr ignore', because
50
  we want to accept globs.
51
329 by Martin Pool
- refactor command functions into command classes
52
* ``bzr ignore`` command that just adds a line to the ``.bzrignore`` file
53
  and makes it versioned.  Fix this to break symlinks.
295 by Martin Pool
todo
54
312 by Martin Pool
todo
55
* Any useful sanity checks in 'bzr ignore'?  Perhaps give a warning if
56
  they try to add a single file which is already versioned, or if they
57
  add a pattern which already exists, or if it looks like they gave an
58
  unquoted glob.
310 by Martin Pool
- new 'bzr ignored' command!
59
325 by Martin Pool
- more revfile design notes
60
__ http://mail.python.org/pipermail/python-list/2001-April/037847.html
61
327 by Martin Pool
todo
62
* Separate read and write version checks?
325 by Martin Pool
- more revfile design notes
63
405 by Martin Pool
todo
64
* ``bzr status DIR`` should give status on all files under that
65
  directory.
66
484 by Martin Pool
todo
67
* ``bzr log DIR`` should give changes to any files within DIR.
68
329 by Martin Pool
- refactor command functions into command classes
69
* Check all commands have decent help.
70
71
* ``bzr inventory -r REV`` and perhaps unify this with ``bzr ls``,
72
  giving options to display ids, types, etc.
73
341 by Martin Pool
todo
74
* Split BzrError into various more specific subclasses for different
75
  errors people might want to catch.
326 by Martin Pool
todo
76
393 by Martin Pool
todo: export to tarball
77
* If the export destination ends in '.tar', '.tar.gz', etc then create
78
  a tarball instead of a directory.  (Need to actually make a
79
  temporary directory and then tar that up.)
80
81
  http://www.gelato.unsw.edu.au/archives/git/0504/2194.html
395 by Martin Pool
- fix error raised from invalid InventoryEntry name
82
  
414 by Martin Pool
todo
83
* RemoteBranch could maintain a cache either in memory or on disk.  We
84
  know more than an external cache might about which files are
85
  immutable and which can vary.  On the other hand, it's much simpler
86
  to just use an external proxy cache.
87
586 by Martin Pool
todo
88
  Perhaps ~/.bzr/http-cache.  Baz has a fairly simple cache under
89
  ~/.arch-cache, containing revision information encoded almost as a
90
  bunch of archives.  Perhaps we could simply store full paths.
91
487 by Martin Pool
todo
92
* Maybe also store directories in the statcache so that we can quickly
93
  identify that they still exist.
94
570 by Martin Pool
doc
95
* Diff should show timestamps; for files from the working directory we
96
  can use the file itself; for files from a revision we should use the
97
  commit time of the revision.
98
414 by Martin Pool
todo
99
282 by Martin Pool
- move all TODO items into ./TODO
100
Medium things
101
-------------
102
103
* Merge revert patch.
104
329 by Martin Pool
- refactor command functions into command classes
105
* ``bzr mv`` that does either rename or move as in Unix.
282 by Martin Pool
- move all TODO items into ./TODO
106
478 by Martin Pool
- put back support for running diff or status on
107
* More efficient diff of only selected files.  We should be able to
108
  just get the id for the selected files, look up their location and
109
  diff just those files.  No need to traverse the entire inventories.
282 by Martin Pool
- move all TODO items into ./TODO
110
479 by Martin Pool
todo
111
* ``bzr status DIR`` or ``bzr diff DIR`` should report on all changes
112
  under that directory.
113
282 by Martin Pool
- move all TODO items into ./TODO
114
* Fix up Inventory objects to represent root object as an entry.
115
552 by Martin Pool
- update todo list
116
* Don't convert entire entry from ElementTree to an object when it is
117
  read in, but rather wait until the program actually wants to know
118
  about that node.
282 by Martin Pool
- move all TODO items into ./TODO
119
120
* Extract changes from one revision to the next to a text form
121
  suitable for transmission over email.
122
123
* More test cases.
124
491 by Martin Pool
- Selective commit!
125
  - Selected-file commit
126
127
  - Impossible selected-file commit: adding things in non-versioned
128
    directories, crossing renames, etc.
129
282 by Martin Pool
- move all TODO items into ./TODO
130
* Write a reproducible benchmark, perhaps importing various kernel versions.
131
132
* Directly import diffs!  It seems a bit redundant to need to rescan
133
  the directory to work out what files diff added/deleted/changed when
134
  all the information is there in the diff in the first place.
135
  Getting the exact behaviour for added/deleted subdirectories etc
136
  might be hard.
137
138
  At the very least we could run diffstat over the diff, or perhaps
139
  read the status output from patch.  Just knowing which files might
140
  be modified would be enough to guide the add and commit.
141
  
142
  Given this we might be able to import patches at 1/second or better.
143
144
* Get branch over http.
145
146
* Pull pure updates over http.
147
148
* revfile compression.
149
150
* Split inventory into per-directory files.
151
284 by Martin Pool
- more TODO items
152
* Fix ignore file parsing:
153
154
  - fnmatch is not the same as unix patterns
155
156
  - perhaps add extended globs from rsh/rsync
157
158
  - perhaps a pattern that matches only directories or non-directories
159
312 by Martin Pool
todo
160
* Consider using Python logging library as well as/instead of
161
  bzrlib.trace.
162
334 by Martin Pool
doc
163
* Commands should give some progress indication by default.
164
165
  - But quieten this with ``--silent``.
166
312 by Martin Pool
todo
167
* Change to using gettext message localization.
282 by Martin Pool
- move all TODO items into ./TODO
168
315 by Martin Pool
todo
169
* Make a clearer separation between internal and external bzrlib
170
  interfaces.  Make internal interfaces use protected names.  Write at
171
  least some documentation for those APIs, probably as docstrings.
172
173
  Consider using ZopeInterface definitions for the external interface;
174
  I think these are already used in PyBaz.  They allow automatic
175
  checking of the interface but may be unfamiliar to general Python
321 by Martin Pool
doc: revfile storage and related things
176
  developers, so I'm not really keen.
315 by Martin Pool
todo
177
178
* Commands to dump out all command help into a manpage or HTML file or
179
  whatever.
180
326 by Martin Pool
todo
181
* Handle symlinks in the working directory; at the very least it
182
  should be possible for them to be present and ignored/unknown
183
  without causing assertion failures. 
184
185
  Eventually symlinks should be versioned.
186
329 by Martin Pool
- refactor command functions into command classes
187
* Allow init in a subdirectory to create a nested repository, but only
188
  if the subdirectory is not already versioned.   Perhaps also require
189
  a ``--nested`` to protect against confusion.
190
191
* Branch names? 
192
339 by Martin Pool
many more diffs
193
* More test framework:
194
195
  - Class that describes the state of a working tree so we can just
196
    assert it's equal.
197
342 by Martin Pool
todo
198
* There are too many methods on Branch() that really manipulate the
346 by Martin Pool
todo
199
  WorkingTree.  They should be moved across.  
200
201
  Also there are some methods which are duplicated on Tree and
202
  Inventory objects, and it should be made more clear which ones are
203
  proxies and which ones behave differently, and how.
342 by Martin Pool
todo
204
361 by Martin Pool
todo
205
* Try using XSLT to add some formatting to REST-generated HTML.  Or
206
  maybe write a small Python program that specifies a header and foot
207
  for the pages and calls into the docutils libraries.
208
366 by Martin Pool
todo
209
* --format=xml for log, status and other commands.
329 by Martin Pool
- refactor command functions into command classes
210
370 by Martin Pool
todo
211
* Attempting to explicitly add a file that's already added should give
212
  a warning; however there should be no warning for directories (since
213
  we scan for new children) or files encountered in a directory that's
214
  being scanned.
329 by Martin Pool
- refactor command functions into command classes
215
377 by Martin Pool
- todo notes on inventory
216
* Better handling of possible collisions on case-losing filesystems;
217
  make sure a single file does not get added twice under different
218
  names.
219
220
* Clean up XML inventory:
221
222
  - Use nesting rather than parent_id pointers.
223
224
  - Hold the ElementTree in memory in the Inventory object and work
225
    directly on that, rather than converting into Python objects every
453 by Martin Pool
- Split WorkingTree into its own file
226
    time it is read in.  Probably still exposoe it through some kind of
377 by Martin Pool
- todo notes on inventory
227
    object interface though, but perhaps that should just be a proxy
228
    for the elements.
229
230
  - Less special cases for the root directory. 
231
388 by Martin Pool
doc
232
* Perhaps inventories should remember the revision in which each file
233
  was last changed, as well as its current state?  This is a bit
234
  redundant but might often be interested to know.
235
442 by Martin Pool
todo
236
* stat cache should perhaps only stat files as necessary, rather than
237
  doing them all up-front.  On the other hand, that disallows the
238
  opimization of stating them in inode order.
239
451 by Martin Pool
todo
240
* It'd be nice to pipeline multiple HTTP requests.  Often we can
241
  predict what will be wanted in future: all revisions, or all texts
242
  in a particular revision, etc.  
243
244
  urlgrabber's docs say they are working on batched downloads; we
245
  could perhaps ride on that or just create a background thread (ew).
246
459 by Martin Pool
- diff now uses stat-cache -- much faster
247
* Paranoid mode where we never trust SHA-1 matches.
248
502 by Martin Pool
todo
249
* Don't commit if there are no changes unless forced.
250
522 by Martin Pool
todo
251
* --dry-run mode for commit?  (Or maybe just run with
252
  check-command=false?)
502 by Martin Pool
todo
253
254
* Generally, be a bit more verbose unless --silent is specified.
255
522 by Martin Pool
todo
256
* Function that finds all changes to files under a given directory;
257
  perhaps log should use this if a directory is given.
258
548 by Martin Pool
- Write statcache using \u style encoding to avoid
259
* XML attributes might have trouble with filenames containing \n and
260
  \r.  Do we really want to support this?  I think perhaps not.
261
574 by Martin Pool
todo
262
* Remember execute bits, so that exports will work OK.
263
579 by Martin Pool
todo
264
* Unify smart_add and plain Branch.add(); perhaps smart_add should
265
  just build a list of files to add and pass that to the regular add
266
  function.
267
315 by Martin Pool
todo
268
282 by Martin Pool
- move all TODO items into ./TODO
269
Large things
270
------------
271
321 by Martin Pool
doc: revfile storage and related things
272
* Generate annotations from current file relative to previous
273
  annotations.
274
275
  - Is it necessary to store any kind of annotation where data was
276
    deleted?
277
325 by Martin Pool
- more revfile design notes
278
* Update revfile_ format and make it active:
321 by Martin Pool
doc: revfile storage and related things
279
280
  - Texts should be identified by something keyed on the revision, not
281
    an individual text-id.  This is much more useful for annotate I
282
    think; we want to map back to the revision that last changed it.
283
284
  - Access revfile revisions through the Tree/Store classes.
285
286
  - Check them from check commands.
287
288
  - Store annotations.
289
325 by Martin Pool
- more revfile design notes
290
.. _revfile: revfile.html
291
294 by Martin Pool
todo
292
* Hooks for pre-commit, post-commit, etc.
293
294
  Consider the security implications; probably should not enable hooks
295
  for remotely-fetched branches by default.
296
297
* Pre-commit check.  If this hook is defined, it needs to be handled
298
  specially: create a temporary directory containing the tree as it
299
  will be after the commit.  This means excluding any ignored/unknown
300
  files, and respecting selective commits.  Run the pre-commit check
301
  (e.g. compile and run test suite) in there.
302
519 by Martin Pool
- todo: discussion of pre-commit tests
303
  Possibly this should be done by splitting the commit function into
304
  several parts (under a single interface).  It is already rather
305
  large.  Decomposition:
306
307
   - find tree modifications and prepare in-memory inventory
308
309
   - export that inventory to a temporary directory
310
311
   - run the test in that temporary directory
312
313
   - if that succeeded, continue to actually finish the commit
314
315
  What should be done with the text of modified files while this is
316
  underway?  I don't think we want to count on holding them in memory
317
  and we can't trust the working files to stay in one place so I
318
  suppose we need to move them into the text store, or otherwise into
319
  a temporary directory.
320
321
  If the commit does not actually complete, we would rather the
322
  content was not left behind in the stores.  
323
282 by Martin Pool
- move all TODO items into ./TODO
324
* Web interface
325
326
* GUI (maybe in Python GTK+?)
327
284 by Martin Pool
- more TODO items
328
* C library interface
321 by Martin Pool
doc: revfile storage and related things
329
330
* Expansion of $Id$ keywords within working files.  Perhaps do this in
331
  exports first as a simpler case because then we don't need to deal
332
  with removing the tags on the way back in.
333
329 by Martin Pool
- refactor command functions into command classes
334
* ``bzr find``