bzr branch
http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
| 
2052.3.2
by John Arbash Meinel
 Change Copyright .. by Canonical to Copyright ... Canonical  | 
1  | 
# Copyright (C) 2005 Canonical Ltd
 | 
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
2  | 
#   Authors: Robert Collins <robert.collins@canonical.com>
 | 
3  | 
#
 | 
|
4  | 
# This program is free software; you can redistribute it and/or modify
 | 
|
5  | 
# it under the terms of the GNU General Public License as published by
 | 
|
6  | 
# the Free Software Foundation; either version 2 of the License, or
 | 
|
7  | 
# (at your option) any later version.
 | 
|
8  | 
#
 | 
|
9  | 
# This program is distributed in the hope that it will be useful,
 | 
|
10  | 
# but WITHOUT ANY WARRANTY; without even the implied warranty of
 | 
|
11  | 
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
 | 
|
12  | 
# GNU General Public License for more details.
 | 
|
13  | 
#
 | 
|
14  | 
# You should have received a copy of the GNU General Public License
 | 
|
15  | 
# along with this program; if not, write to the Free Software
 | 
|
16  | 
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
 | 
|
17  | 
||
18  | 
"""This module provides a transactional facility.
 | 
|
19  | 
||
20  | 
Transactions provide hooks to allow data objects (i.e. inventory weaves or
 | 
|
21  | 
the revision-history file) to be placed in a registry and retrieved later
 | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
22  | 
during the same transaction. Transactions in bzr are not atomic - they
 | 
23  | 
depend on data ordering of writes, so we do not have commit or rollback
 | 
|
24  | 
facilities at the transaction level.
 | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
25  | 
|
26  | 
Read only transactions raise an assert when objects are listed as dirty
 | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
27  | 
against them - preventing unintended writes.
 | 
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
28  | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
29  | 
Write transactions preserve dirty objects in the cache, though due to the
 | 
30  | 
write ordering approach we use for consistency 'dirty' is a misleading term.
 | 
|
31  | 
A dirty object is one we have modified.
 | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
32  | 
|
33  | 
Both read and write transactions *may* flush unchanged objects out of 
 | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
34  | 
memory, unless they are marked as 'precious' which indicates that 
 | 
35  | 
repeated reads cannot be obtained if the object is ejected, or that
 | 
|
36  | 
the object is an expensive one for obtaining.
 | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
37  | 
"""
 | 
38  | 
||
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
39  | 
import sys  | 
40  | 
||
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
41  | 
import bzrlib.errors as errors  | 
42  | 
from bzrlib.identitymap import IdentityMap, NullIdentityMap  | 
|
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
43  | 
from bzrlib.trace import mutter  | 
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
44  | 
|
45  | 
||
46  | 
class ReadOnlyTransaction(object):  | 
|
47  | 
"""A read only unit of work for data objects."""  | 
|
48  | 
||
49  | 
def finish(self):  | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
50  | 
"""Clean up this transaction."""  | 
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
51  | 
|
52  | 
def __init__(self):  | 
|
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
53  | 
super(ReadOnlyTransaction, self).__init__()  | 
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
54  | 
self.map = IdentityMap()  | 
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
55  | 
self._clean_objects = set()  | 
56  | 
self._clean_queue = []  | 
|
57  | 
self._limit = -1  | 
|
58  | 
self._precious_objects = set()  | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
59  | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
60  | 
def is_clean(self, an_object):  | 
61  | 
"""Return True if an_object is clean."""  | 
|
| 
1711.9.11
by John Arbash Meinel
 change return foo in bar to return (foo in bar)  | 
62  | 
return (an_object in self._clean_objects)  | 
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
63  | 
|
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
64  | 
def register_clean(self, an_object, precious=False):  | 
65  | 
"""Register an_object as being clean.  | 
|
66  | 
        
 | 
|
67  | 
        If the precious hint is True, the object will not
 | 
|
68  | 
        be ejected from the object identity map ever.
 | 
|
69  | 
        """
 | 
|
70  | 
self._clean_objects.add(an_object)  | 
|
71  | 
self._clean_queue.append(an_object)  | 
|
72  | 
if precious:  | 
|
73  | 
self._precious_objects.add(an_object)  | 
|
74  | 
self._trim()  | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
75  | 
|
| 
1417.1.8
by Robert Collins
 use transactions in the weave store interface, which enables caching for log  | 
76  | 
def register_dirty(self, an_object):  | 
77  | 
"""Register an_object as being dirty."""  | 
|
| 
1553.5.33
by Martin Pool
 LockDir review comment fixes  | 
78  | 
raise errors.ReadOnlyObjectDirtiedError(an_object)  | 
| 
1417.1.8
by Robert Collins
 use transactions in the weave store interface, which enables caching for log  | 
79  | 
|
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
80  | 
def set_cache_size(self, size):  | 
81  | 
"""Set a new cache size."""  | 
|
82  | 
assert -1 <= size  | 
|
83  | 
self._limit = size  | 
|
84  | 
self._trim()  | 
|
85  | 
||
86  | 
def _trim(self):  | 
|
87  | 
"""Trim the cache back if needed."""  | 
|
88  | 
if self._limit < 0 or self._limit - len(self._clean_objects) > 0:  | 
|
89  | 
            return
 | 
|
90  | 
needed = len(self._clean_objects) - self._limit  | 
|
91  | 
offset = 0  | 
|
92  | 
while needed and offset < len(self._clean_objects):  | 
|
93  | 
            # references we know of:
 | 
|
94  | 
            # temp passed to getrefcount in our frame
 | 
|
95  | 
            # temp in getrefcount's frame
 | 
|
96  | 
            # the map forward
 | 
|
97  | 
            # the map backwards
 | 
|
98  | 
            # _clean_objects
 | 
|
99  | 
            # _clean_queue
 | 
|
100  | 
            # 1 missing ?
 | 
|
101  | 
if (sys.getrefcount(self._clean_queue[offset]) <= 7 and  | 
|
102  | 
not self._clean_queue[offset] in self._precious_objects):  | 
|
103  | 
removed = self._clean_queue[offset]  | 
|
104  | 
self._clean_objects.remove(removed)  | 
|
105  | 
del self._clean_queue[offset]  | 
|
106  | 
self.map.remove_object(removed)  | 
|
107  | 
mutter('removed object %r', removed)  | 
|
108  | 
needed -= 1  | 
|
109  | 
else:  | 
|
110  | 
offset += 1  | 
|
111  | 
||
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
112  | 
def writeable(self):  | 
113  | 
"""Read only transactions do not allow writes."""  | 
|
114  | 
||
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
115  | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
116  | 
class WriteTransaction(ReadOnlyTransaction):  | 
117  | 
"""A write transaction  | 
|
118  | 
||
119  | 
    - caches domain objects
 | 
|
120  | 
    - clean objects can be removed from the cache
 | 
|
121  | 
    - dirty objects are retained.
 | 
|
122  | 
    """
 | 
|
123  | 
||
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
124  | 
def finish(self):  | 
125  | 
"""Clean up this transaction."""  | 
|
126  | 
for thing in self._dirty_objects:  | 
|
127  | 
callback = getattr(thing, 'transaction_finished', None)  | 
|
128  | 
if callback is not None:  | 
|
129  | 
callback()  | 
|
130  | 
||
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
131  | 
def __init__(self):  | 
132  | 
super(WriteTransaction, self).__init__()  | 
|
133  | 
self._dirty_objects = set()  | 
|
134  | 
||
135  | 
def is_dirty(self, an_object):  | 
|
136  | 
"""Return True if an_object is dirty."""  | 
|
| 
1711.9.11
by John Arbash Meinel
 change return foo in bar to return (foo in bar)  | 
137  | 
return (an_object in self._dirty_objects)  | 
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
138  | 
|
139  | 
def register_dirty(self, an_object):  | 
|
140  | 
"""Register an_object as being dirty.  | 
|
141  | 
        
 | 
|
142  | 
        Dirty objects are not ejected from the identity map
 | 
|
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
143  | 
        until the transaction finishes and get informed
 | 
144  | 
        when the transaction finishes.
 | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
145  | 
        """
 | 
146  | 
self._dirty_objects.add(an_object)  | 
|
147  | 
if self.is_clean(an_object):  | 
|
148  | 
self._clean_objects.remove(an_object)  | 
|
149  | 
del self._clean_queue[self._clean_queue.index(an_object)]  | 
|
150  | 
self._trim()  | 
|
151  | 
||
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
152  | 
def writeable(self):  | 
153  | 
"""Write transactions allow writes."""  | 
|
154  | 
return True  | 
|
155  | 
||
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
156  | 
|
157  | 
class PassThroughTransaction(object):  | 
|
158  | 
"""A pass through transaction  | 
|
159  | 
    
 | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
160  | 
    - nothing is cached.
 | 
161  | 
    - nothing ever gets into the identity map.
 | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
162  | 
    """
 | 
163  | 
||
164  | 
def finish(self):  | 
|
| 
1563.2.34
by Robert Collins
 Remove the commit and rollback transaction methods as misleading, and implement a WriteTransaction  | 
165  | 
"""Clean up this transaction."""  | 
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
166  | 
for thing in self._dirty_objects:  | 
167  | 
callback = getattr(thing, 'transaction_finished', None)  | 
|
168  | 
if callback is not None:  | 
|
169  | 
callback()  | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
170  | 
|
171  | 
def __init__(self):  | 
|
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
172  | 
super(PassThroughTransaction, self).__init__()  | 
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
173  | 
self.map = NullIdentityMap()  | 
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
174  | 
self._dirty_objects = set()  | 
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
175  | 
|
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
176  | 
def register_clean(self, an_object, precious=False):  | 
177  | 
"""Register an_object as being clean.  | 
|
178  | 
        
 | 
|
179  | 
        Note that precious is only a hint, and PassThroughTransaction
 | 
|
180  | 
        ignores it.
 | 
|
181  | 
        """
 | 
|
| 
1417.1.6
by Robert Collins
 introduce transactions for grouping actions done to and with branches  | 
182  | 
|
| 
1417.1.8
by Robert Collins
 use transactions in the weave store interface, which enables caching for log  | 
183  | 
def register_dirty(self, an_object):  | 
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
184  | 
"""Register an_object as being dirty.  | 
185  | 
        
 | 
|
186  | 
        Dirty objects get informed
 | 
|
187  | 
        when the transaction finishes.
 | 
|
188  | 
        """
 | 
|
189  | 
self._dirty_objects.add(an_object)  | 
|
| 
1417.1.8
by Robert Collins
 use transactions in the weave store interface, which enables caching for log  | 
190  | 
|
| 
1417.1.10
by Robert Collins
 add a cache bound to Transactions, and a precious facility, so that we keep inventory.weave in memory, but can discard weaves for other such files.  | 
191  | 
def set_cache_size(self, ignored):  | 
192  | 
"""Do nothing, we are passing through."""  | 
|
| 
1594.2.20
by Robert Collins
 Add finished() notifications to transactions.  | 
193  | 
|
194  | 
def writeable(self):  | 
|
195  | 
"""Pass through transactions allow writes."""  | 
|
196  | 
return True  |