To get this branch, use:
bzr branch
http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
- Committer: John Arbash Meinel
- Date: 2009-10-17 04:43:14 UTC
- Revision ID: john@arbash-meinel.com-20091017044314-nlvrrqnz0f2wzcp4
change the GroupcompressBlock code a bit.
If the first decompress request is big enough, just decompress everything.
And when we do that, let go of the decompressobj.
After digging through the zlib code, it looks like 1 zlib stream object
contains a 5kB internal state, and another 4*64kB buffers. (about 260kB
of total state.)
That turns out to be quite a lot if you think about it.
In the case of branching a copy of 'bzr.dev' locally, this turned out
to be 383MB w/ bzr.dev and 345MB w/ only this patch. (So ~11% of peak).
Also, this was 'unreferenced' memory, because it is hidden in the
zlib internal state in working buffers. So it wasn't memory that Meliae
could find. \o/.
If the first decompress request is big enough, just decompress everything.
And when we do that, let go of the decompressobj.
After digging through the zlib code, it looks like 1 zlib stream object
contains a 5kB internal state, and another 4*64kB buffers. (about 260kB
of total state.)
That turns out to be quite a lot if you think about it.
In the case of branching a copy of 'bzr.dev' locally, this turned out
to be 383MB w/ bzr.dev and 345MB w/ only this patch. (So ~11% of peak).
Also, this was 'unreferenced' memory, because it is hidden in the
zlib internal state in working buffers. So it wasn't memory that Meliae
could find. \o/.
| Filename | Latest Rev | Last Changed | Committer | Comment | Size | ||
|---|---|---|---|---|---|---|---|
 ..
|
|||||||
configobj
|
1185.12.49 | 19 years ago | Aaron Bentley | Switched to ConfigObj |
|
||
|
effbot
|
1185.1.29 | 19 years ago | Robert Collins | merge merge tweaks from aaron, which includes late |
|
||
|
elementtree
|
1185.1.29 | 19 years ago | Robert Collins | merge merge tweaks from aaron, which includes late |
|
||
|
tests
|
2613.1.2 | 18 years ago | Martin Pool | Move bencode tests into util.tests |
|
||
__init__.py |
1185.1.29 | 19 years ago | Robert Collins | merge merge tweaks from aaron, which includes late | Empty |
|
|
|
_bencode_py.py |
4679.8.10 | 15 years ago | John Arbash Meinel | quick patch to allow bencode to handle StaticTuple | 4.4 KB |
|
|
|
bencode.py |
4420.3.1 | 16 years ago | Matt Nordhoff | bzrlib.util.bencode's deprecation warning used the | 1005 bytes |
|
|
|
simplemapi.py |
3943.8.1 | 16 years ago | Marius Kruger | remove all trailing whitespace from bzr source | 8.2 KB |
|
|