/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
2018.5.157 by Andrew Bennetts
Remove unnecessary trivial divergences from bzr.dev.
1
# Copyright (C) 2006, 2007 Canonical Ltd
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
2
#
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
7
#
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
12
#
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
17
"""Basic server-side logic for dealing with requests.
18
19
**XXX**:
20
21
The class names are a little confusing: the protocol will instantiate a
22
SmartServerRequestHandler, whose dispatch_command method creates an instance of
23
a SmartServerRequest subclass.
24
25
The request_handlers registry tracks SmartServerRequest classes (rather than
26
SmartServerRequestHandler).
27
"""
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
28
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
29
import tempfile
30
2402.1.2 by Andrew Bennetts
Deal with review comments.
31
from bzrlib import (
32
    bzrdir,
33
    errors,
34
    registry,
35
    revision,
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
36
    urlutils,
2402.1.2 by Andrew Bennetts
Deal with review comments.
37
    )
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
38
from bzrlib.bundle.serializer import write_bundle
39
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
40
41
class SmartServerRequest(object):
2692.1.10 by Andrew Bennetts
More docstring polish
42
    """Base class for request handlers.
43
    
44
    To define a new request, subclass this class and override the `do` method
45
    (and if appropriate, `do_body` as well).  Request implementors should take
46
    care to call `translate_client_path` and `transport_from_client_path` as
47
    appropriate when dealing with paths received from the client.
48
    """
3195.3.2 by Andrew Bennetts
Checkpoint first rough cut of SmartServerRequestProtocolThree, this implementation reuses the _StatefulDecoder class. Plus some attempts to start tidying the smart protocol tests.
49
    # XXX: rename this class to BaseSmartServerRequestHandler ?  A request
50
    # *handler* is a different concept to the request.
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
51
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
52
    def __init__(self, backing_transport, root_client_path='/'):
2402.1.2 by Andrew Bennetts
Deal with review comments.
53
        """Constructor.
54
55
        :param backing_transport: the base transport to be used when performing
56
            this request.
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
57
        :param root_client_path: the client path that maps to the root of
2692.1.9 by Andrew Bennetts
Docstrings for translate_client_path and transport_from_client_path.
58
            backing_transport.  This is used to interpret relpaths received
59
            from the client.  Clients will not be able to refer to paths above
2692.1.16 by Andrew Bennetts
Improve comments.
60
            this root.  If root_client_path is None, then no translation will
61
            be performed on client paths.  Default is '/'.
2402.1.2 by Andrew Bennetts
Deal with review comments.
62
        """
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
63
        self._backing_transport = backing_transport
2692.1.14 by Andrew Bennetts
All WSGI tests passing, and manual testing works too.
64
        if root_client_path is not None:
65
            if not root_client_path.startswith('/'):
66
                root_client_path = '/' + root_client_path
67
            if not root_client_path.endswith('/'):
68
                root_client_path += '/'
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
69
        self._root_client_path = root_client_path
2018.5.5 by Andrew Bennetts
Pass body_bytes directly to SmartServerRequest.do_body
70
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
71
    def _check_enabled(self):
72
        """Raises DisabledMethod if this method is disabled."""
73
        pass
74
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
75
    def do(self, *args):
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
76
        """Mandatory extension point for SmartServerRequest subclasses.
77
        
78
        Subclasses must implement this.
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
79
        
80
        This should return a SmartServerResponse if this command expects to
81
        receive no body.
82
        """
2018.5.5 by Andrew Bennetts
Pass body_bytes directly to SmartServerRequest.do_body
83
        raise NotImplementedError(self.do)
84
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
85
    def execute(self, *args):
86
        """Public entry point to execute this request.
87
88
        It will return a SmartServerResponse if the command does not expect a
89
        body.
90
91
        :param *args: the arguments of the request.
92
        """
93
        self._check_enabled()
94
        return self.do(*args)
95
2018.5.5 by Andrew Bennetts
Pass body_bytes directly to SmartServerRequest.do_body
96
    def do_body(self, body_bytes):
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
97
        """Called if the client sends a body with the request.
3184.1.10 by Robert Collins
Change the smart server verb for Repository.stream_revisions_chunked to use SearchResults as the request mechanism for downloads.
98
99
        The do() method is still called, and must have returned None.
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
100
        
101
        Must return a SmartServerResponse.
102
        """
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
103
        raise NotImplementedError(self.do_body)
104
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
105
    def do_chunk(self, chunk_bytes):
106
        """Called with each body chunk if the request has a streamed body.
107
108
        The do() method is still called, and must have returned None.
109
        """
110
        raise NotImplementedError(self.do_chunk)
111
112
    def do_end(self):
113
        """Called when the end of the request has been received."""
114
        pass
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
115
    
116
    def translate_client_path(self, client_path):
2692.1.9 by Andrew Bennetts
Docstrings for translate_client_path and transport_from_client_path.
117
        """Translate a path received from a network client into a local
118
        relpath.
119
120
        All paths received from the client *must* be translated.
121
2692.1.14 by Andrew Bennetts
All WSGI tests passing, and manual testing works too.
122
        :param client_path: the path from the client.
2692.1.9 by Andrew Bennetts
Docstrings for translate_client_path and transport_from_client_path.
123
        :returns: a relpath that may be used with self._backing_transport
2692.1.14 by Andrew Bennetts
All WSGI tests passing, and manual testing works too.
124
            (unlike the untranslated client_path, which must not be used with
125
            the backing transport).
2692.1.9 by Andrew Bennetts
Docstrings for translate_client_path and transport_from_client_path.
126
        """
2692.1.14 by Andrew Bennetts
All WSGI tests passing, and manual testing works too.
127
        if self._root_client_path is None:
128
            # no translation necessary!
129
            return client_path
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
130
        if not client_path.startswith('/'):
131
            client_path = '/' + client_path
132
        if client_path.startswith(self._root_client_path):
133
            path = client_path[len(self._root_client_path):]
134
            relpath = urlutils.joinpath('/', path)
3376.2.4 by Martin Pool
Remove every assert statement from bzrlib!
135
            if not relpath.startswith('/'):
136
                raise ValueError(relpath)
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
137
            return '.' + relpath
138
        else:
139
            raise errors.PathNotChild(client_path, self._root_client_path)
140
141
    def transport_from_client_path(self, client_path):
2692.1.9 by Andrew Bennetts
Docstrings for translate_client_path and transport_from_client_path.
142
        """Get a backing transport corresponding to the location referred to by
143
        a network client.
144
145
        :seealso: translate_client_path
146
        :returns: a transport cloned from self._backing_transport
147
        """
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
148
        relpath = self.translate_client_path(client_path)
2692.1.16 by Andrew Bennetts
Improve comments.
149
        return self._backing_transport.clone(relpath)
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
150
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
151
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
152
class SmartServerResponse(object):
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
153
    """A response to a client request.
154
    
155
    This base class should not be used. Instead use
156
    SuccessfulSmartServerResponse and FailedSmartServerResponse as appropriate.
157
    """
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
158
2748.4.2 by Andrew Bennetts
Add protocol (version two) support for streaming bodies (using chunking) in responses.
159
    def __init__(self, args, body=None, body_stream=None):
160
        """Constructor.
161
162
        :param args: tuple of response arguments.
163
        :param body: string of a response body.
164
        :param body_stream: iterable of bytestrings to be streamed to the
165
            client.
166
        """
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
167
        self.args = args
2748.4.2 by Andrew Bennetts
Add protocol (version two) support for streaming bodies (using chunking) in responses.
168
        if body is not None and body_stream is not None:
169
            raise errors.BzrError(
170
                "'body' and 'body_stream' are mutually exclusive.")
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
171
        self.body = body
2748.4.2 by Andrew Bennetts
Add protocol (version two) support for streaming bodies (using chunking) in responses.
172
        self.body_stream = body_stream
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
173
2402.1.1 by Andrew Bennetts
Use the Command pattern for handling smart server commands.
174
    def __eq__(self, other):
175
        if other is None:
176
            return False
2748.4.2 by Andrew Bennetts
Add protocol (version two) support for streaming bodies (using chunking) in responses.
177
        return (other.args == self.args and
178
                other.body == self.body and
179
                other.body_stream is self.body_stream)
2402.1.1 by Andrew Bennetts
Use the Command pattern for handling smart server commands.
180
181
    def __repr__(self):
3691.2.6 by Martin Pool
Disable RemoteBranch stacking, but get get_stacked_on_url working, and passing back exceptions
182
        return "<%s args=%r body=%r>" % (self.__class__.__name__,
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
183
            self.args, self.body)
2402.1.1 by Andrew Bennetts
Use the Command pattern for handling smart server commands.
184
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
185
2432.4.2 by Robert Collins
Add FailedSmartServerResponse.
186
class FailedSmartServerResponse(SmartServerResponse):
187
    """A SmartServerResponse for a request which failed."""
188
189
    def is_successful(self):
190
        """FailedSmartServerResponse are not successful."""
191
        return False
192
193
2432.4.1 by Robert Collins
Add SuccessfulSmartServerResponse.
194
class SuccessfulSmartServerResponse(SmartServerResponse):
195
    """A SmartServerResponse for a successfully completed request."""
196
197
    def is_successful(self):
198
        """SuccessfulSmartServerResponse are successful."""
199
        return True
200
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
201
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
202
class SmartServerRequestHandler(object):
203
    """Protocol logic for smart server.
204
    
205
    This doesn't handle serialization at all, it just processes requests and
206
    creates responses.
207
    """
208
209
    # IMPORTANT FOR IMPLEMENTORS: It is important that SmartServerRequestHandler
210
    # not contain encoding or decoding logic to allow the wire protocol to vary
211
    # from the object protocol: we will want to tweak the wire protocol separate
212
    # from the object model, and ideally we will be able to do that without
213
    # having a SmartServerRequestHandler subclass for each wire protocol, rather
214
    # just a Protocol subclass.
215
216
    # TODO: Better way of representing the body for commands that take it,
217
    # and allow it to be streamed into the server.
218
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
219
    def __init__(self, backing_transport, commands, root_client_path):
2018.5.17 by Andrew Bennetts
Paramaterise the commands handled by SmartServerRequestHandler.
220
        """Constructor.
221
222
        :param backing_transport: a Transport to handle requests for.
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
223
        :param commands: a registry mapping command names to SmartServerRequest
2018.5.17 by Andrew Bennetts
Paramaterise the commands handled by SmartServerRequestHandler.
224
            subclasses. e.g. bzrlib.transport.smart.vfs.vfs_commands.
225
        """
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
226
        self._backing_transport = backing_transport
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
227
        self._root_client_path = root_client_path
2018.5.17 by Andrew Bennetts
Paramaterise the commands handled by SmartServerRequestHandler.
228
        self._commands = commands
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
229
        self._body_bytes = ''
230
        self.response = None
231
        self.finished_reading = False
232
        self._command = None
233
234
    def accept_body(self, bytes):
235
        """Accept body data."""
236
237
        # TODO: This should be overriden for each command that desired body data
238
        # to handle the right format of that data, i.e. plain bytes, a bundle,
239
        # etc.  The deserialisation into that format should be done in the
240
        # Protocol object.
241
242
        # default fallback is to accumulate bytes.
243
        self._body_bytes += bytes
244
        
245
    def end_of_body(self):
246
        """No more body data will be received."""
247
        self._run_handler_code(self._command.do_body, (self._body_bytes,), {})
248
        # cannot read after this.
249
        self.finished_reading = True
250
251
    def dispatch_command(self, cmd, args):
252
        """Deprecated compatibility method.""" # XXX XXX
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
253
        try:
254
            command = self._commands.get(cmd)
255
        except LookupError:
3245.4.29 by Andrew Bennetts
Add/tidy some comments, remove dud test_errors_are_logged test, add explicit UnknownSmartMethod to v3.
256
            raise errors.UnknownSmartMethod(cmd)
2692.1.1 by Andrew Bennetts
Add translate_client_path method to SmartServerRequest.
257
        self._command = command(self._backing_transport, self._root_client_path)
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
258
        self._run_handler_code(self._command.execute, args, {})
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
259
260
    def _run_handler_code(self, callable, args, kwargs):
261
        """Run some handler specific code 'callable'.
262
263
        If a result is returned, it is considered to be the commands response,
264
        and finished_reading is set true, and its assigned to self.response.
265
266
        Any exceptions caught are translated and a response object created
267
        from them.
268
        """
269
        result = self._call_converting_errors(callable, args, kwargs)
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
270
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
271
        if result is not None:
272
            self.response = result
273
            self.finished_reading = True
274
275
    def _call_converting_errors(self, callable, args, kwargs):
276
        """Call callable converting errors to Response objects."""
277
        # XXX: most of this error conversion is VFS-related, and thus ought to
278
        # be in SmartServerVFSRequestHandler somewhere.
279
        try:
280
            return callable(*args, **kwargs)
281
        except errors.NoSuchFile, e:
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
282
            return FailedSmartServerResponse(('NoSuchFile', e.path))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
283
        except errors.FileExists, e:
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
284
            return FailedSmartServerResponse(('FileExists', e.path))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
285
        except errors.DirectoryNotEmpty, e:
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
286
            return FailedSmartServerResponse(('DirectoryNotEmpty', e.path))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
287
        except errors.ShortReadvError, e:
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
288
            return FailedSmartServerResponse(('ShortReadvError',
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
289
                e.path, str(e.offset), str(e.length), str(e.actual)))
3691.2.6 by Martin Pool
Disable RemoteBranch stacking, but get get_stacked_on_url working, and passing back exceptions
290
        except errors.UnstackableRepositoryFormat, e:
291
            return FailedSmartServerResponse(('UnstackableRepositoryFormat',
292
                str(e.format), e.url))
293
        except errors.UnstackableBranchFormat, e:
294
            return FailedSmartServerResponse(('UnstackableBranchFormat',
295
                str(e.format), e.url))
296
        except errors.NotStacked, e:
297
            return FailedSmartServerResponse(('NotStacked',))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
298
        except UnicodeError, e:
299
            # If it is a DecodeError, than most likely we are starting
300
            # with a plain string
301
            str_or_unicode = e.object
302
            if isinstance(str_or_unicode, unicode):
303
                # XXX: UTF-8 might have \x01 (our seperator byte) in it.  We
304
                # should escape it somehow.
305
                val = 'u:' + str_or_unicode.encode('utf-8')
306
            else:
307
                val = 's:' + str_or_unicode.encode('base64')
308
            # This handles UnicodeEncodeError or UnicodeDecodeError
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
309
            return FailedSmartServerResponse((e.__class__.__name__,
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
310
                    e.encoding, val, str(e.start), str(e.end), e.reason))
311
        except errors.TransportNotPossible, e:
312
            if e.msg == "readonly transport":
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
313
                return FailedSmartServerResponse(('ReadOnlyError', ))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
314
            else:
315
                raise
316
3195.3.2 by Andrew Bennetts
Checkpoint first rough cut of SmartServerRequestProtocolThree, this implementation reuses the _StatefulDecoder class. Plus some attempts to start tidying the smart protocol tests.
317
    def headers_received(self, headers):
3245.4.33 by Andrew Bennetts
Remove unused no_body_received method on SmartServerRequestHandler.
318
        # Just a no-op at the moment.
3195.3.2 by Andrew Bennetts
Checkpoint first rough cut of SmartServerRequestProtocolThree, this implementation reuses the _StatefulDecoder class. Plus some attempts to start tidying the smart protocol tests.
319
        pass
320
321
    def args_received(self, args):
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
322
        cmd = args[0]
323
        args = args[1:]
324
        try:
325
            command = self._commands.get(cmd)
326
        except LookupError:
3245.4.48 by Andrew Bennetts
raise UnknownSmartMethod from dispatch_command.
327
            raise errors.UnknownSmartMethod(cmd)
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
328
        self._command = command(self._backing_transport)
329
        self._run_handler_code(self._command.execute, args, {})
3195.3.2 by Andrew Bennetts
Checkpoint first rough cut of SmartServerRequestProtocolThree, this implementation reuses the _StatefulDecoder class. Plus some attempts to start tidying the smart protocol tests.
330
331
    def prefixed_body_received(self, body_bytes):
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
332
        """No more body data will be received."""
333
        self._run_handler_code(self._command.do_body, (body_bytes,), {})
334
        # cannot read after this.
335
        self.finished_reading = True
3195.3.2 by Andrew Bennetts
Checkpoint first rough cut of SmartServerRequestProtocolThree, this implementation reuses the _StatefulDecoder class. Plus some attempts to start tidying the smart protocol tests.
336
337
    def body_chunk_received(self, chunk_bytes):
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
338
        self._run_handler_code(self._command.do_chunk, (chunk_bytes,), {})
3195.3.2 by Andrew Bennetts
Checkpoint first rough cut of SmartServerRequestProtocolThree, this implementation reuses the _StatefulDecoder class. Plus some attempts to start tidying the smart protocol tests.
339
3195.3.4 by Andrew Bennetts
Make the general request handler dispatch version 3 events to the specific request handler (i.e. to the SmartServerRequest instance).
340
    def end_received(self):
341
        self._run_handler_code(self._command.do_end, (), {})
3195.3.2 by Andrew Bennetts
Checkpoint first rough cut of SmartServerRequestProtocolThree, this implementation reuses the _StatefulDecoder class. Plus some attempts to start tidying the smart protocol tests.
342
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
343
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
344
class HelloRequest(SmartServerRequest):
2432.2.6 by Andrew Bennetts
Improve HelloRequest's docstring.
345
    """Answer a version request with the highest protocol version this server
346
    supports.
347
    """
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
348
349
    def do(self):
3245.4.59 by Andrew Bennetts
Various tweaks in response to Martin's review.
350
        return SuccessfulSmartServerResponse(('ok', '2'))
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
351
352
353
class GetBundleRequest(SmartServerRequest):
2402.1.2 by Andrew Bennetts
Deal with review comments.
354
    """Get a bundle of from the null revision to the specified revision."""
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
355
356
    def do(self, path, revision_id):
357
        # open transport relative to our base
2692.1.7 by Andrew Bennetts
Translate path in GetBundleRequest too.
358
        t = self.transport_from_client_path(path)
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
359
        control, extra_path = bzrdir.BzrDir.open_containing_from_transport(t)
360
        repo = control.open_repository()
361
        tmpf = tempfile.TemporaryFile()
362
        base_revision = revision.NULL_REVISION
363
        write_bundle(repo, revision_id, base_revision, tmpf)
364
        tmpf.seek(0)
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
365
        return SuccessfulSmartServerResponse((), tmpf.read())
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
366
367
2018.5.95 by Andrew Bennetts
Add a Transport.is_readonly remote call, let {Branch,Repository}.lock_write remote call return UnlockableTransport, and miscellaneous test fixes.
368
class SmartServerIsReadonly(SmartServerRequest):
369
    # XXX: this request method belongs somewhere else.
370
371
    def do(self):
372
        if self._backing_transport.is_readonly():
373
            answer = 'yes'
374
        else:
375
            answer = 'no'
2432.4.5 by Robert Collins
Make using SuccessfulSmartServerResponse and FailedSmartServerResponse mandatory rather than optional in smart server logic.
376
        return SuccessfulSmartServerResponse((answer,))
2018.5.95 by Andrew Bennetts
Add a Transport.is_readonly remote call, let {Branch,Repository}.lock_write remote call return UnlockableTransport, and miscellaneous test fixes.
377
378
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
379
request_handlers = registry.Registry()
380
request_handlers.register_lazy(
381
    'append', 'bzrlib.smart.vfs', 'AppendRequest')
382
request_handlers.register_lazy(
2018.5.59 by Robert Collins
Get BranchConfig working somewhat on RemoteBranches (Robert Collins, Vincent Ladeuil).
383
    'Branch.get_config_file', 'bzrlib.smart.branch', 'SmartServerBranchGetConfigFile')
384
request_handlers.register_lazy(
3691.2.5 by Martin Pool
Add Branch.get_stacked_on_url rpc and tests for same
385
    'Branch.get_stacked_on_url', 'bzrlib.smart.branch', 'SmartServerBranchRequestGetStackedOnURL')
386
request_handlers.register_lazy(
2018.5.51 by Wouter van Heyst
Test and implement RemoteBranch.last_revision_info()
387
    'Branch.last_revision_info', 'bzrlib.smart.branch', 'SmartServerBranchRequestLastRevisionInfo')
388
request_handlers.register_lazy(
2018.5.79 by Andrew Bennetts
Implement RemoteBranch.lock_write/unlock as smart operations.
389
    'Branch.lock_write', 'bzrlib.smart.branch', 'SmartServerBranchRequestLockWrite')
390
request_handlers.register_lazy(
2018.5.38 by Robert Collins
Implement RemoteBranch.revision_history().
391
    'Branch.revision_history', 'bzrlib.smart.branch', 'SmartServerRequestRevisionHistory')
392
request_handlers.register_lazy(
2018.5.77 by Wouter van Heyst
Fix typo in request_handlers registration of Branch.set_last_revision, and test that registration
393
    'Branch.set_last_revision', 'bzrlib.smart.branch', 'SmartServerBranchRequestSetLastRevision')
2018.12.3 by Andrew Bennetts
Add a Branch.set_last_revision smart method, and make RemoteBranch.set_revision_history use it.
394
request_handlers.register_lazy(
2892.2.1 by Andrew Bennetts
Add Branch.set_last_revision_info smart method, and make the RemoteBranch client use it.
395
    'Branch.set_last_revision_info', 'bzrlib.smart.branch',
396
    'SmartServerBranchRequestSetLastRevisionInfo')
397
request_handlers.register_lazy(
3441.5.25 by Andrew Bennetts
Rename Branch.set_last_revision_descendant verb to Branch.set_last_revision_ex. It's a cop out, but at least it's not misleading.
398
    'Branch.set_last_revision_ex', 'bzrlib.smart.branch',
399
    'SmartServerBranchRequestSetLastRevisionEx')
3441.5.6 by Andrew Bennetts
Greatly simplify RemoteBranch.update_revisions. Still needs more tests.
400
request_handlers.register_lazy(
2018.5.79 by Andrew Bennetts
Implement RemoteBranch.lock_write/unlock as smart operations.
401
    'Branch.unlock', 'bzrlib.smart.branch', 'SmartServerBranchRequestUnlock')
402
request_handlers.register_lazy(
3221.3.2 by Robert Collins
* New remote method ``RemoteBzrDir.find_repositoryV2`` adding support for
403
    'BzrDir.find_repository', 'bzrlib.smart.bzrdir', 'SmartServerRequestFindRepositoryV1')
404
request_handlers.register_lazy(
405
    'BzrDir.find_repositoryV2', 'bzrlib.smart.bzrdir', 'SmartServerRequestFindRepositoryV2')
2018.5.34 by Robert Collins
Get test_remote.BasicRemoteObjectTests.test_open_remote_branch passing by implementing a remote method BzrDir.find_repository.
406
request_handlers.register_lazy(
2018.5.42 by Robert Collins
Various hopefully improvements, but wsgi is broken, handing over to spiv :).
407
    'BzrDirFormat.initialize', 'bzrlib.smart.bzrdir', 'SmartServerRequestInitializeBzrDir')
408
request_handlers.register_lazy(
2018.6.1 by Robert Collins
Implement a BzrDir.open_branch smart server method for opening a branch without VFS.
409
    'BzrDir.open_branch', 'bzrlib.smart.bzrdir', 'SmartServerRequestOpenBranch')
410
request_handlers.register_lazy(
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
411
    'delete', 'bzrlib.smart.vfs', 'DeleteRequest')
412
request_handlers.register_lazy(
413
    'get', 'bzrlib.smart.vfs', 'GetRequest')
414
request_handlers.register_lazy(
415
    'get_bundle', 'bzrlib.smart.request', 'GetBundleRequest')
416
request_handlers.register_lazy(
417
    'has', 'bzrlib.smart.vfs', 'HasRequest')
418
request_handlers.register_lazy(
419
    'hello', 'bzrlib.smart.request', 'HelloRequest')
420
request_handlers.register_lazy(
2018.5.37 by Andrew Bennetts
Make sure all the request handlers in bzrlib/smart/vfs.py have consistent names.
421
    'iter_files_recursive', 'bzrlib.smart.vfs', 'IterFilesRecursiveRequest')
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
422
request_handlers.register_lazy(
423
    'list_dir', 'bzrlib.smart.vfs', 'ListDirRequest')
424
request_handlers.register_lazy(
2018.5.37 by Andrew Bennetts
Make sure all the request handlers in bzrlib/smart/vfs.py have consistent names.
425
    'mkdir', 'bzrlib.smart.vfs', 'MkdirRequest')
426
request_handlers.register_lazy(
427
    'move', 'bzrlib.smart.vfs', 'MoveRequest')
428
request_handlers.register_lazy(
429
    'put', 'bzrlib.smart.vfs', 'PutRequest')
430
request_handlers.register_lazy(
431
    'put_non_atomic', 'bzrlib.smart.vfs', 'PutNonAtomicRequest')
432
request_handlers.register_lazy(
433
    'readv', 'bzrlib.smart.vfs', 'ReadvRequest')
434
request_handlers.register_lazy(
435
    'rename', 'bzrlib.smart.vfs', 'RenameRequest')
2018.10.2 by v.ladeuil+lp at free
gather_stats server side and request registration
436
request_handlers.register_lazy('Repository.gather_stats',
437
                               'bzrlib.smart.repository',
438
                               'SmartServerRepositoryGatherStats')
3172.5.6 by Robert Collins
Create new smart server verb Repository.get_parent_map.
439
request_handlers.register_lazy('Repository.get_parent_map',
440
                               'bzrlib.smart.repository',
441
                               'SmartServerRepositoryGetParentMap')
2018.5.37 by Andrew Bennetts
Make sure all the request handlers in bzrlib/smart/vfs.py have consistent names.
442
request_handlers.register_lazy(
2018.5.67 by Wouter van Heyst
Implement RemoteRepository.get_revision_graph (Wouter van Heyst, Robert Collins)
443
    'Repository.get_revision_graph', 'bzrlib.smart.repository', 'SmartServerRepositoryGetRevisionGraph')
444
request_handlers.register_lazy(
2018.5.40 by Robert Collins
Implement a remote Repository.has_revision method.
445
    'Repository.has_revision', 'bzrlib.smart.repository', 'SmartServerRequestHasRevision')
446
request_handlers.register_lazy(
2018.5.57 by Robert Collins
Implement RemoteRepository.is_shared (Robert Collins, Vincent Ladeuil).
447
    'Repository.is_shared', 'bzrlib.smart.repository', 'SmartServerRepositoryIsShared')
448
request_handlers.register_lazy(
2018.5.78 by Andrew Bennetts
Implement RemoteRepository.lock_write/unlock to expect and send tokens over the
449
    'Repository.lock_write', 'bzrlib.smart.repository', 'SmartServerRepositoryLockWrite')
450
request_handlers.register_lazy(
451
    'Repository.unlock', 'bzrlib.smart.repository', 'SmartServerRepositoryUnlock')
452
request_handlers.register_lazy(
2018.18.1 by Martin Pool
Add stub Repository.tarball smart method
453
    'Repository.tarball', 'bzrlib.smart.repository',
454
    'SmartServerRepositoryTarball')
455
request_handlers.register_lazy(
2018.5.37 by Andrew Bennetts
Make sure all the request handlers in bzrlib/smart/vfs.py have consistent names.
456
    'rmdir', 'bzrlib.smart.vfs', 'RmdirRequest')
457
request_handlers.register_lazy(
458
    'stat', 'bzrlib.smart.vfs', 'StatRequest')
2018.5.26 by Andrew Bennetts
Extract a simple SmartClient class from RemoteTransport, and a hack to avoid VFS operations when probing for a bzrdir over a smart transport.
459
request_handlers.register_lazy(
2018.5.95 by Andrew Bennetts
Add a Transport.is_readonly remote call, let {Branch,Repository}.lock_write remote call return UnlockableTransport, and miscellaneous test fixes.
460
    'Transport.is_readonly', 'bzrlib.smart.request', 'SmartServerIsReadonly')
461
request_handlers.register_lazy(
2018.5.163 by Andrew Bennetts
Deal with various review comments from Robert.
462
    'BzrDir.open', 'bzrlib.smart.bzrdir', 'SmartServerRequestOpenBzrDir')