/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
1
# Copyright (C) 2006 Canonical Ltd
2
#
3
# This program is free software; you can redistribute it and/or modify
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
7
#
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
12
#
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
17
"""Basic server-side logic for dealing with requests."""
18
19
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
20
import tempfile
21
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
22
from bzrlib import bzrdir, errors, registry, revision
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
23
from bzrlib.bundle.serializer import write_bundle
24
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
25
26
class SmartServerRequest(object):
27
    """Base class for request handlers.
28
    """
29
30
    def __init__(self, backing_transport):
31
        self._backing_transport = backing_transport
2018.5.5 by Andrew Bennetts
Pass body_bytes directly to SmartServerRequest.do_body
32
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
33
    def _check_enabled(self):
34
        """Raises DisabledMethod if this method is disabled."""
35
        pass
36
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
37
    def do(self, *args):
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
38
        """Mandatory extension point for SmartServerRequest subclasses.
39
        
40
        Subclasses must implement this.
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
41
        
42
        This should return a SmartServerResponse if this command expects to
43
        receive no body.
44
        """
2018.5.5 by Andrew Bennetts
Pass body_bytes directly to SmartServerRequest.do_body
45
        raise NotImplementedError(self.do)
46
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
47
    def execute(self, *args):
48
        """Public entry point to execute this request.
49
50
        It will return a SmartServerResponse if the command does not expect a
51
        body.
52
53
        :param *args: the arguments of the request.
54
        """
55
        self._check_enabled()
56
        return self.do(*args)
57
2018.5.5 by Andrew Bennetts
Pass body_bytes directly to SmartServerRequest.do_body
58
    def do_body(self, body_bytes):
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
59
        """Called if the client sends a body with the request.
60
        
61
        Must return a SmartServerResponse.
62
        """
63
        # TODO: if a client erroneously sends a request that shouldn't have a
64
        # body, what to do?  Probably SmartServerRequestHandler should catch
65
        # this NotImplementedError and translate it into a 'bad request' error
66
        # to send to the client.
2018.5.4 by Andrew Bennetts
Split smart server VFS logic out into a new file, and start using the command pattern in the SmartServerRequestHandler.
67
        raise NotImplementedError(self.do_body)
68
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
69
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
70
class SmartServerResponse(object):
71
    """Response generated by SmartServerRequestHandler."""
72
73
    def __init__(self, args, body=None):
74
        self.args = args
75
        self.body = body
76
2018.6.1 by Robert Collins
Implement a BzrDir.open_branch smart server method for opening a branch without VFS.
77
    def __eq__(self, other):
78
        return other.args == self.args and other.body == self.body
79
80
    def __repr__(self):
81
        return "<SmartServerResponse args=%r body=%r>" % (self.args, self.body)
82
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
83
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
84
class SmartServerRequestHandler(object):
85
    """Protocol logic for smart server.
86
    
87
    This doesn't handle serialization at all, it just processes requests and
88
    creates responses.
89
    """
90
91
    # IMPORTANT FOR IMPLEMENTORS: It is important that SmartServerRequestHandler
92
    # not contain encoding or decoding logic to allow the wire protocol to vary
93
    # from the object protocol: we will want to tweak the wire protocol separate
94
    # from the object model, and ideally we will be able to do that without
95
    # having a SmartServerRequestHandler subclass for each wire protocol, rather
96
    # just a Protocol subclass.
97
98
    # TODO: Better way of representing the body for commands that take it,
99
    # and allow it to be streamed into the server.
100
2018.5.17 by Andrew Bennetts
Paramaterise the commands handled by SmartServerRequestHandler.
101
    def __init__(self, backing_transport, commands):
102
        """Constructor.
103
104
        :param backing_transport: a Transport to handle requests for.
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
105
        :param commands: a registry mapping command names to SmartServerRequest
2018.5.17 by Andrew Bennetts
Paramaterise the commands handled by SmartServerRequestHandler.
106
            subclasses. e.g. bzrlib.transport.smart.vfs.vfs_commands.
107
        """
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
108
        self._backing_transport = backing_transport
2018.5.17 by Andrew Bennetts
Paramaterise the commands handled by SmartServerRequestHandler.
109
        self._commands = commands
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
110
        self._body_bytes = ''
111
        self.response = None
112
        self.finished_reading = False
113
        self._command = None
114
115
    def accept_body(self, bytes):
116
        """Accept body data."""
117
118
        # TODO: This should be overriden for each command that desired body data
119
        # to handle the right format of that data, i.e. plain bytes, a bundle,
120
        # etc.  The deserialisation into that format should be done in the
121
        # Protocol object.
122
123
        # default fallback is to accumulate bytes.
124
        self._body_bytes += bytes
125
        
126
    def end_of_body(self):
127
        """No more body data will be received."""
128
        self._run_handler_code(self._command.do_body, (self._body_bytes,), {})
129
        # cannot read after this.
130
        self.finished_reading = True
131
132
    def dispatch_command(self, cmd, args):
133
        """Deprecated compatibility method.""" # XXX XXX
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
134
        try:
135
            command = self._commands.get(cmd)
136
        except LookupError:
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
137
            raise errors.SmartProtocolError("bad request %r" % (cmd,))
138
        self._command = command(self._backing_transport)
2018.5.24 by Andrew Bennetts
Setting NO_SMART_VFS in environment will disable VFS methods in the smart server. (Robert Collins, John Arbash Meinel, Andrew Bennetts)
139
        self._run_handler_code(self._command.execute, args, {})
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
140
141
    def _run_handler_code(self, callable, args, kwargs):
142
        """Run some handler specific code 'callable'.
143
144
        If a result is returned, it is considered to be the commands response,
145
        and finished_reading is set true, and its assigned to self.response.
146
147
        Any exceptions caught are translated and a response object created
148
        from them.
149
        """
150
        result = self._call_converting_errors(callable, args, kwargs)
2018.5.19 by Andrew Bennetts
Add docstrings to all the new modules, and a few other places.
151
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
152
        if result is not None:
153
            self.response = result
154
            self.finished_reading = True
155
156
    def _call_converting_errors(self, callable, args, kwargs):
157
        """Call callable converting errors to Response objects."""
158
        # XXX: most of this error conversion is VFS-related, and thus ought to
159
        # be in SmartServerVFSRequestHandler somewhere.
160
        try:
161
            return callable(*args, **kwargs)
162
        except errors.NoSuchFile, e:
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
163
            return SmartServerResponse(('NoSuchFile', e.path))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
164
        except errors.FileExists, e:
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
165
            return SmartServerResponse(('FileExists', e.path))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
166
        except errors.DirectoryNotEmpty, e:
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
167
            return SmartServerResponse(('DirectoryNotEmpty', e.path))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
168
        except errors.ShortReadvError, e:
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
169
            return SmartServerResponse(('ShortReadvError',
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
170
                e.path, str(e.offset), str(e.length), str(e.actual)))
171
        except UnicodeError, e:
172
            # If it is a DecodeError, than most likely we are starting
173
            # with a plain string
174
            str_or_unicode = e.object
175
            if isinstance(str_or_unicode, unicode):
176
                # XXX: UTF-8 might have \x01 (our seperator byte) in it.  We
177
                # should escape it somehow.
178
                val = 'u:' + str_or_unicode.encode('utf-8')
179
            else:
180
                val = 's:' + str_or_unicode.encode('base64')
181
            # This handles UnicodeEncodeError or UnicodeDecodeError
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
182
            return SmartServerResponse((e.__class__.__name__,
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
183
                    e.encoding, val, str(e.start), str(e.end), e.reason))
184
        except errors.TransportNotPossible, e:
185
            if e.msg == "readonly transport":
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
186
                return SmartServerResponse(('ReadOnlyError', ))
2018.5.14 by Andrew Bennetts
Move SmartTCPServer to smart/server.py, and SmartServerRequestHandler to smart/request.py.
187
            else:
188
                raise
189
190
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
191
class HelloRequest(SmartServerRequest):
192
    """Answer a version request with my version."""
193
194
    def do(self):
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
195
        return SmartServerResponse(('ok', '1'))
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
196
197
198
class GetBundleRequest(SmartServerRequest):
199
200
    def do(self, path, revision_id):
201
        # open transport relative to our base
202
        t = self._backing_transport.clone(path)
203
        control, extra_path = bzrdir.BzrDir.open_containing_from_transport(t)
204
        repo = control.open_repository()
205
        tmpf = tempfile.TemporaryFile()
206
        base_revision = revision.NULL_REVISION
207
        write_bundle(repo, revision_id, base_revision, tmpf)
208
        tmpf.seek(0)
2018.5.16 by Andrew Bennetts
Move SmartServerResponse to smart/request.py, untangling more import dependencies.
209
        return SmartServerResponse((), tmpf.read())
2018.5.6 by Andrew Bennetts
Tidy ups, and turn do_hello and do_get_bundle into command objects.
210
211
2018.5.26 by Andrew Bennetts
Extract a simple SmartClient class from RemoteTransport, and a hack to avoid VFS operations when probing for a bzrdir over a smart transport.
212
# This exists solely to help RemoteObjectHacking.  It should be removed
213
# eventually.  It should not be considered part of the real smart server
214
# protocol!
215
class ProbeDontUseRequest(SmartServerRequest):
216
217
    def do(self, path):
218
        from bzrlib.bzrdir import BzrDirFormat
219
        t = self._backing_transport.clone(path)
220
        default_format = BzrDirFormat.get_default_format()
221
        real_bzrdir = default_format.open(t, _found=True)
222
        try:
223
            real_bzrdir._format.probe_transport(t)
224
        except (errors.NotBranchError, errors.UnknownFormatError):
225
            answer = 'no'
226
        else:
227
            answer = 'yes'
228
        return SmartServerResponse((answer,))
229
230
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
231
request_handlers = registry.Registry()
232
request_handlers.register_lazy(
233
    'append', 'bzrlib.smart.vfs', 'AppendRequest')
234
request_handlers.register_lazy(
2018.5.34 by Robert Collins
Get test_remote.BasicRemoteObjectTests.test_open_remote_branch passing by implementing a remote method BzrDir.find_repository.
235
    'BzrDir.find_repository', 'bzrlib.smart.bzrdir', 'SmartServerRequestFindRepository')
236
request_handlers.register_lazy(
2018.6.1 by Robert Collins
Implement a BzrDir.open_branch smart server method for opening a branch without VFS.
237
    'BzrDir.open_branch', 'bzrlib.smart.bzrdir', 'SmartServerRequestOpenBranch')
238
request_handlers.register_lazy(
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
239
    'delete', 'bzrlib.smart.vfs', 'DeleteRequest')
240
request_handlers.register_lazy(
241
    'get', 'bzrlib.smart.vfs', 'GetRequest')
242
request_handlers.register_lazy(
243
    'get_bundle', 'bzrlib.smart.request', 'GetBundleRequest')
244
request_handlers.register_lazy(
245
    'has', 'bzrlib.smart.vfs', 'HasRequest')
246
request_handlers.register_lazy(
247
    'hello', 'bzrlib.smart.request', 'HelloRequest')
248
request_handlers.register_lazy(
2018.5.37 by Andrew Bennetts
Make sure all the request handlers in bzrlib/smart/vfs.py have consistent names.
249
    'iter_files_recursive', 'bzrlib.smart.vfs', 'IterFilesRecursiveRequest')
2018.5.23 by Andrew Bennetts
Use a Registry for smart server command handlers.
250
request_handlers.register_lazy(
251
    'list_dir', 'bzrlib.smart.vfs', 'ListDirRequest')
252
request_handlers.register_lazy(
2018.5.37 by Andrew Bennetts
Make sure all the request handlers in bzrlib/smart/vfs.py have consistent names.
253
    'mkdir', 'bzrlib.smart.vfs', 'MkdirRequest')
254
request_handlers.register_lazy(
255
    'move', 'bzrlib.smart.vfs', 'MoveRequest')
256
request_handlers.register_lazy(
257
    'put', 'bzrlib.smart.vfs', 'PutRequest')
258
request_handlers.register_lazy(
259
    'put_non_atomic', 'bzrlib.smart.vfs', 'PutNonAtomicRequest')
260
request_handlers.register_lazy(
261
    'readv', 'bzrlib.smart.vfs', 'ReadvRequest')
262
request_handlers.register_lazy(
263
    'rename', 'bzrlib.smart.vfs', 'RenameRequest')
264
request_handlers.register_lazy(
265
    'rmdir', 'bzrlib.smart.vfs', 'RmdirRequest')
266
request_handlers.register_lazy(
267
    'stat', 'bzrlib.smart.vfs', 'StatRequest')
2018.5.26 by Andrew Bennetts
Extract a simple SmartClient class from RemoteTransport, and a hack to avoid VFS operations when probing for a bzrdir over a smart transport.
268
request_handlers.register_lazy(
269
    'probe_dont_use', 'bzrlib.smart.request', 'ProbeDontUseRequest')