/brz/remove-bazaar

To get this branch, use:
bzr branch http://gegoxaren.bato24.eu/bzr/brz/remove-bazaar
2241.1.4 by Martin Pool
Moved old weave-based repository formats into bzrlib.repofmt.weaverepo.
1
# Copyright (C) 2005, 2006, 2007 Canonical Ltd
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
2
#
3
# This program is free software; you can redistribute it and/or modify
2052.3.1 by John Arbash Meinel
Add tests to cleanup the copyright of all source files
4
# it under the terms of the GNU General Public License as published by
5
# the Free Software Foundation; either version 2 of the License, or
6
# (at your option) any later version.
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
7
#
8
# This program is distributed in the hope that it will be useful,
9
# but WITHOUT ANY WARRANTY; without even the implied warranty of
10
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
11
# GNU General Public License for more details.
12
#
13
# You should have received a copy of the GNU General Public License
14
# along with this program; if not, write to the Free Software
15
# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
16
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
17
"""Tests for the test framework."""
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
18
2036.1.1 by John Arbash Meinel
test that logs are kept or deleted when appropriate
19
import cStringIO
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
20
import os
1707.2.1 by Robert Collins
'bzr selftest --benchmark' will run a new benchmarking selftest.
21
from StringIO import StringIO
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
22
import sys
1707.2.3 by Robert Collins
Add a setBenchmarkTime method to the bzrlib test result allowing introduction of granular benchmarking. (Robert Collins, Martin Pool).
23
import time
1185.33.95 by Martin Pool
New TestSkipped facility, and tests for it.
24
import unittest
1185.62.24 by John Arbash Meinel
Changing the exception that sftp.py throws when it can't find paramiko, so that the test suite can handle it.
25
import warnings
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
26
1534.4.25 by Robert Collins
Add a --transport parameter to the test suite to set the default transport to be used in the test suite.
27
import bzrlib
1986.4.9 by Robert Collins
``TestCase.make_branch_and_memory_tree`` now takes a format
28
from bzrlib import (
29
    bzrdir,
2241.1.4 by Martin Pool
Moved old weave-based repository formats into bzrlib.repofmt.weaverepo.
30
    errors,
1986.4.9 by Robert Collins
``TestCase.make_branch_and_memory_tree`` now takes a format
31
    memorytree,
32
    osutils,
33
    repository,
2241.1.4 by Martin Pool
Moved old weave-based repository formats into bzrlib.repofmt.weaverepo.
34
    symbol_versioning,
3193.1.1 by Vincent Ladeuil
Helper to filter test suite building by module when loading a list.
35
    tests,
1986.4.9 by Robert Collins
``TestCase.make_branch_and_memory_tree`` now takes a format
36
    )
1534.11.1 by Robert Collins
Teach bzr selftest to use a progress bar in non verbose mode.
37
from bzrlib.progress import _BaseProgressBar
2241.1.4 by Martin Pool
Moved old weave-based repository formats into bzrlib.repofmt.weaverepo.
38
from bzrlib.repofmt import weaverepo
2696.1.1 by Martin Pool
Remove things deprecated in 0.11 and earlier
39
from bzrlib.symbol_versioning import (
3128.1.2 by Vincent Ladeuil
Tweak as per review feedback: s/randomise.*/randomize&/, 0.92 -> 1.0.
40
    one_zero,
41
    zero_eleven,
42
    zero_ten,
43
    )
1526.1.3 by Robert Collins
Merge from upstream.
44
from bzrlib.tests import (
1534.4.31 by Robert Collins
cleanedup test_outside_wt
45
                          ChrootedTestCase,
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
46
                          ExtendedTestResult,
2367.1.4 by Robert Collins
Add operating system Feature model to bzrlib.tests to allow writing tests
47
                          Feature,
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
48
                          KnownFailure,
1526.1.3 by Robert Collins
Merge from upstream.
49
                          TestCase,
50
                          TestCaseInTempDir,
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
51
                          TestCaseWithMemoryTransport,
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
52
                          TestCaseWithTransport,
2729.1.1 by Martin Pool
Add TestNotApplicable exception and handling of it; document test parameterization
53
                          TestNotApplicable,
1526.1.3 by Robert Collins
Merge from upstream.
54
                          TestSkipped,
1707.2.1 by Robert Collins
'bzr selftest --benchmark' will run a new benchmarking selftest.
55
                          TestSuite,
2394.2.7 by Ian Clatworthy
Added whitebox tests - filter_suite_by_re and sort_suite_by_re
56
                          TestUtil,
1526.1.3 by Robert Collins
Merge from upstream.
57
                          TextTestRunner,
2367.1.6 by Robert Collins
Allow per-test-fixture feature requirements via 'requireFeature'.(Robert Collins)
58
                          UnavailableFeature,
2921.6.9 by Robert Collins
* New helper function ``bzrlib.tests.condition_id_re`` which helps
59
                          condition_id_re,
2921.6.8 by Robert Collins
* New helper function ``bzrlib.tests.condition_isinstance`` which helps
60
                          condition_isinstance,
2921.6.9 by Robert Collins
* New helper function ``bzrlib.tests.condition_id_re`` which helps
61
                          exclude_tests_by_condition,
2921.6.2 by Robert Collins
* New helper method ``bzrlib.tests.exclude_tests_by_re`` which gives a new
62
                          exclude_tests_by_re,
2921.6.7 by Robert Collins
* New helper function ``bzrlib.tests.filter_suite_by_condition`` which
63
                          filter_suite_by_condition,
2921.6.2 by Robert Collins
* New helper method ``bzrlib.tests.exclude_tests_by_re`` which gives a new
64
                          filter_suite_by_re,
2394.2.7 by Ian Clatworthy
Added whitebox tests - filter_suite_by_re and sort_suite_by_re
65
                          iter_suite_tests,
2921.6.6 by Robert Collins
* The ``exclude_pattern`` and ``random_order`` parameters to the function
66
                          preserve_input,
3128.1.2 by Vincent Ladeuil
Tweak as per review feedback: s/randomise.*/randomize&/, 0.92 -> 1.0.
67
                          randomize_suite,
3350.5.1 by Robert Collins
* New helper function for splitting test suites ``split_suite_by_condition``.
68
                          split_suite_by_condition,
2921.6.1 by Robert Collins
* New helper method ``bzrlib.tests.split_suite_by_re`` which splits a test
69
                          split_suite_by_re,
2493.2.8 by Aaron Bentley
Convert old lsprof tests to require new LSProf Feature instead of skipping
70
                          test_lsprof,
71
                          test_suite,
1526.1.3 by Robert Collins
Merge from upstream.
72
                          )
1910.14.1 by Andrew Bennetts
Fix to make_branch_and_tree's behavior when used with an sftp transport.
73
from bzrlib.tests.test_sftp_transport import TestCaseWithSFTPServer
1707.2.2 by Robert Collins
Start on bench_add, an add benchtest.
74
from bzrlib.tests.TestUtil import _load_module_by_name
1773.4.1 by Martin Pool
Add pyflakes makefile target; fix many warnings
75
from bzrlib.trace import note
1910.13.1 by Andrew Bennetts
Make make_bzrdir preserve the transport.
76
from bzrlib.transport.memory import MemoryServer, MemoryTransport
1951.1.1 by Andrew Bennetts
Make test_bench_history and _get_bzr_source_tree tolerant of UnknownFormatError for the bzr workingtree.
77
from bzrlib.version import _get_bzr_source_tree
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
78
79
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
80
def _test_ids(test_suite):
81
    """Get the ids for the tests in a test suite."""
82
    return [t.id() for t in iter_suite_tests(test_suite)]
83
84
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
85
class SelftestTests(TestCase):
86
87
    def test_import_tests(self):
88
        mod = _load_module_by_name('bzrlib.tests.test_selftest')
89
        self.assertEqual(mod.SelftestTests, SelftestTests)
90
91
    def test_import_test_failure(self):
92
        self.assertRaises(ImportError,
93
                          _load_module_by_name,
94
                          'bzrlib.no-name-yet')
95
96
class MetaTestLog(TestCase):
1526.1.1 by Robert Collins
Run the test suite with no locale as well as the default locale. Also add a test for build_tree_shape to selftest.
97
1185.51.1 by Martin Pool
Better message when failing to import a test suite.
98
    def test_logging(self):
99
        """Test logs are captured when a test fails."""
100
        self.log('a test message')
101
        self._log_file.flush()
1927.3.1 by Carl Friedrich Bolz
Throw away on-disk logfile when possible.
102
        self.assertContainsRe(self._get_log(keep_log_file=True),
103
                              'a test message\n')
1185.33.95 by Martin Pool
New TestSkipped facility, and tests for it.
104
105
1526.1.1 by Robert Collins
Run the test suite with no locale as well as the default locale. Also add a test for build_tree_shape to selftest.
106
class TestTreeShape(TestCaseInTempDir):
107
108
    def test_unicode_paths(self):
109
        filename = u'hell\u00d8'
1526.1.4 by Robert Collins
forgot my self.
110
        try:
111
            self.build_tree_contents([(filename, 'contents of hello')])
112
        except UnicodeEncodeError:
113
            raise TestSkipped("can't build unicode working tree in "
114
                "filesystem encoding %s" % sys.getfilesystemencoding())
1526.1.1 by Robert Collins
Run the test suite with no locale as well as the default locale. Also add a test for build_tree_shape to selftest.
115
        self.failUnlessExists(filename)
1526.1.3 by Robert Collins
Merge from upstream.
116
117
1530.1.1 by Robert Collins
Minimal infrastructure to test TransportTestProviderAdapter.
118
class TestTransportProviderAdapter(TestCase):
1530.1.21 by Robert Collins
Review feedback fixes.
119
    """A group of tests that test the transport implementation adaption core.
120
1551.1.1 by Martin Pool
[merge] branch-formats branch, and reconcile changes
121
    This is a meta test that the tests are applied to all available 
122
    transports.
123
1530.1.21 by Robert Collins
Review feedback fixes.
124
    This will be generalised in the future which is why it is in this 
125
    test file even though it is specific to transport tests at the moment.
126
    """
1530.1.1 by Robert Collins
Minimal infrastructure to test TransportTestProviderAdapter.
127
1530.1.11 by Robert Collins
Push the transport permutations list into each transport module allowing for automatic testing of new modules that are registered as transports.
128
    def test_get_transport_permutations(self):
1530.1.21 by Robert Collins
Review feedback fixes.
129
        # this checks that we the module get_test_permutations call
130
        # is made by the adapter get_transport_test_permitations method.
1530.1.11 by Robert Collins
Push the transport permutations list into each transport module allowing for automatic testing of new modules that are registered as transports.
131
        class MockModule(object):
132
            def get_test_permutations(self):
133
                return sample_permutation
134
        sample_permutation = [(1,2), (3,4)]
2553.2.5 by Robert Collins
And overhaul TransportTestProviderAdapter too.
135
        from bzrlib.tests.test_transport_implementations \
136
            import TransportTestProviderAdapter
1530.1.11 by Robert Collins
Push the transport permutations list into each transport module allowing for automatic testing of new modules that are registered as transports.
137
        adapter = TransportTestProviderAdapter()
138
        self.assertEqual(sample_permutation,
139
                         adapter.get_transport_test_permutations(MockModule()))
140
141
    def test_adapter_checks_all_modules(self):
1530.1.21 by Robert Collins
Review feedback fixes.
142
        # this checks that the adapter returns as many permurtations as
143
        # there are in all the registered# transport modules for there
144
        # - we assume if this matches its probably doing the right thing
145
        # especially in combination with the tests for setting the right
146
        # classes below.
2553.2.5 by Robert Collins
And overhaul TransportTestProviderAdapter too.
147
        from bzrlib.tests.test_transport_implementations \
148
            import TransportTestProviderAdapter
149
        from bzrlib.transport import _get_transport_modules
1530.1.11 by Robert Collins
Push the transport permutations list into each transport module allowing for automatic testing of new modules that are registered as transports.
150
        modules = _get_transport_modules()
151
        permutation_count = 0
152
        for module in modules:
1185.62.24 by John Arbash Meinel
Changing the exception that sftp.py throws when it can't find paramiko, so that the test suite can handle it.
153
            try:
154
                permutation_count += len(reduce(getattr, 
155
                    (module + ".get_test_permutations").split('.')[1:],
156
                     __import__(module))())
157
            except errors.DependencyNotPresent:
158
                pass
1530.1.11 by Robert Collins
Push the transport permutations list into each transport module allowing for automatic testing of new modules that are registered as transports.
159
        input_test = TestTransportProviderAdapter(
160
            "test_adapter_sets_transport_class")
161
        adapter = TransportTestProviderAdapter()
162
        self.assertEqual(permutation_count,
163
                         len(list(iter(adapter.adapt(input_test)))))
164
1530.1.1 by Robert Collins
Minimal infrastructure to test TransportTestProviderAdapter.
165
    def test_adapter_sets_transport_class(self):
1540.3.21 by Martin Pool
Trim test for TestTransportProviderAdapter to be less dependent on
166
        # Check that the test adapter inserts a transport and server into the
167
        # generated test.
168
        #
169
        # This test used to know about all the possible transports and the
170
        # order they were returned but that seems overly brittle (mbp
171
        # 20060307)
2553.2.5 by Robert Collins
And overhaul TransportTestProviderAdapter too.
172
        from bzrlib.tests.test_transport_implementations \
173
            import TransportTestProviderAdapter
174
        scenarios = TransportTestProviderAdapter().scenarios
1540.3.21 by Martin Pool
Trim test for TestTransportProviderAdapter to be less dependent on
175
        # there are at least that many builtin transports
2553.2.5 by Robert Collins
And overhaul TransportTestProviderAdapter too.
176
        self.assertTrue(len(scenarios) > 6)
177
        one_scenario = scenarios[0]
178
        self.assertIsInstance(one_scenario[0], str)
179
        self.assertTrue(issubclass(one_scenario[1]["transport_class"],
1540.3.21 by Martin Pool
Trim test for TestTransportProviderAdapter to be less dependent on
180
                                   bzrlib.transport.Transport))
2553.2.5 by Robert Collins
And overhaul TransportTestProviderAdapter too.
181
        self.assertTrue(issubclass(one_scenario[1]["transport_server"],
1540.3.21 by Martin Pool
Trim test for TestTransportProviderAdapter to be less dependent on
182
                                   bzrlib.transport.Server))
1534.4.3 by Robert Collins
Implement BranchTestProviderAdapter, so tests now run across all branch formats.
183
184
185
class TestBranchProviderAdapter(TestCase):
186
    """A group of tests that test the branch implementation test adapter."""
187
2553.2.6 by Robert Collins
And overhaul BranchTestProviderAdapter too.
188
    def test_constructor(self):
1534.4.3 by Robert Collins
Implement BranchTestProviderAdapter, so tests now run across all branch formats.
189
        # check that constructor parameters are passed through to the adapted
190
        # test.
2553.2.6 by Robert Collins
And overhaul BranchTestProviderAdapter too.
191
        from bzrlib.tests.branch_implementations import BranchTestProviderAdapter
1534.4.3 by Robert Collins
Implement BranchTestProviderAdapter, so tests now run across all branch formats.
192
        server1 = "a"
193
        server2 = "b"
1534.4.41 by Robert Collins
Branch now uses BzrDir reasonably sanely.
194
        formats = [("c", "C"), ("d", "D")]
1534.4.3 by Robert Collins
Implement BranchTestProviderAdapter, so tests now run across all branch formats.
195
        adapter = BranchTestProviderAdapter(server1, server2, formats)
2553.2.6 by Robert Collins
And overhaul BranchTestProviderAdapter too.
196
        self.assertEqual(2, len(adapter.scenarios))
197
        self.assertEqual([
198
            ('str',
199
             {'branch_format': 'c',
200
              'bzrdir_format': 'C',
201
              'transport_readonly_server': 'b',
202
              'transport_server': 'a'}),
203
            ('str',
204
             {'branch_format': 'd',
205
              'bzrdir_format': 'D',
206
              'transport_readonly_server': 'b',
207
              'transport_server': 'a'})],
208
            adapter.scenarios)
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
209
210
1534.4.39 by Robert Collins
Basic BzrDir support.
211
class TestBzrDirProviderAdapter(TestCase):
212
    """A group of tests that test the bzr dir implementation test adapter."""
213
214
    def test_adapted_tests(self):
215
        # check that constructor parameters are passed through to the adapted
216
        # test.
2553.2.7 by Robert Collins
And overhaul BzrDirTestProviderAdapter too.
217
        from bzrlib.tests.bzrdir_implementations import BzrDirTestProviderAdapter
2018.5.42 by Robert Collins
Various hopefully improvements, but wsgi is broken, handing over to spiv :).
218
        vfs_factory = "v"
1534.4.39 by Robert Collins
Basic BzrDir support.
219
        server1 = "a"
220
        server2 = "b"
221
        formats = ["c", "d"]
2018.5.42 by Robert Collins
Various hopefully improvements, but wsgi is broken, handing over to spiv :).
222
        adapter = BzrDirTestProviderAdapter(vfs_factory,
223
            server1, server2, formats)
2553.2.7 by Robert Collins
And overhaul BzrDirTestProviderAdapter too.
224
        self.assertEqual([
225
            ('str',
226
             {'bzrdir_format': 'c',
227
              'transport_readonly_server': 'b',
228
              'transport_server': 'a',
229
              'vfs_transport_factory': 'v'}),
230
            ('str',
231
             {'bzrdir_format': 'd',
232
              'transport_readonly_server': 'b',
233
              'transport_server': 'a',
234
              'vfs_transport_factory': 'v'})],
235
            adapter.scenarios)
1534.4.39 by Robert Collins
Basic BzrDir support.
236
237
1534.4.40 by Robert Collins
Add RepositoryFormats and allow bzrdir.open or create _repository to be used.
238
class TestRepositoryProviderAdapter(TestCase):
239
    """A group of tests that test the repository implementation test adapter."""
240
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
241
    def test_constructor(self):
242
        # check that constructor parameters are passed through to the
243
        # scenarios.
2553.2.2 by Robert Collins
Move RepositoryTestProviderAdapter into the tests part of the code base.
244
        from bzrlib.tests.repository_implementations import RepositoryTestProviderAdapter
1534.4.40 by Robert Collins
Add RepositoryFormats and allow bzrdir.open or create _repository to be used.
245
        server1 = "a"
246
        server2 = "b"
247
        formats = [("c", "C"), ("d", "D")]
248
        adapter = RepositoryTestProviderAdapter(server1, server2, formats)
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
249
        self.assertEqual([
250
            ('str',
251
             {'bzrdir_format': 'C',
252
              'repository_format': 'c',
253
              'transport_readonly_server': 'b',
254
              'transport_server': 'a'}),
255
            ('str',
256
             {'bzrdir_format': 'D',
257
              'repository_format': 'd',
258
              'transport_readonly_server': 'b',
259
              'transport_server': 'a'})],
260
            adapter.scenarios)
1534.4.40 by Robert Collins
Add RepositoryFormats and allow bzrdir.open or create _repository to be used.
261
2018.5.64 by Robert Collins
Allow Repository tests to be backed onto a specific VFS as needed.
262
    def test_setting_vfs_transport(self):
263
        """The vfs_transport_factory can be set optionally."""
2553.2.2 by Robert Collins
Move RepositoryTestProviderAdapter into the tests part of the code base.
264
        from bzrlib.tests.repository_implementations import RepositoryTestProviderAdapter
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
265
        formats = [("a", "b"), ("c", "d")]
2018.5.64 by Robert Collins
Allow Repository tests to be backed onto a specific VFS as needed.
266
        adapter = RepositoryTestProviderAdapter(None, None, formats,
267
            vfs_transport_factory="vfs")
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
268
        self.assertEqual([
269
            ('str',
270
             {'bzrdir_format': 'b',
271
              'repository_format': 'a',
272
              'transport_readonly_server': None,
273
              'transport_server': None,
274
              'vfs_transport_factory': 'vfs'}),
275
            ('str',
276
             {'bzrdir_format': 'd',
277
              'repository_format': 'c',
278
              'transport_readonly_server': None,
279
              'transport_server': None,
280
              'vfs_transport_factory': 'vfs'})],
281
            adapter.scenarios)
282
283
    def test_formats_to_scenarios(self):
284
        """The adapter can generate all the scenarios needed."""
2553.2.2 by Robert Collins
Move RepositoryTestProviderAdapter into the tests part of the code base.
285
        from bzrlib.tests.repository_implementations import RepositoryTestProviderAdapter
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
286
        no_vfs_adapter = RepositoryTestProviderAdapter("server", "readonly",
287
            [], None)
288
        vfs_adapter = RepositoryTestProviderAdapter("server", "readonly",
289
            [], vfs_transport_factory="vfs")
290
        # no_vfs generate scenarios without vfs_transport_factor
291
        formats = [("c", "C"), (1, "D")]
292
        self.assertEqual([
293
            ('str',
294
             {'bzrdir_format': 'C',
295
              'repository_format': 'c',
296
              'transport_readonly_server': 'readonly',
297
              'transport_server': 'server'}),
298
            ('int',
299
             {'bzrdir_format': 'D',
300
              'repository_format': 1,
301
              'transport_readonly_server': 'readonly',
302
              'transport_server': 'server'})],
303
            no_vfs_adapter.formats_to_scenarios(formats))
304
        self.assertEqual([
305
            ('str',
306
             {'bzrdir_format': 'C',
307
              'repository_format': 'c',
308
              'transport_readonly_server': 'readonly',
309
              'transport_server': 'server',
310
              'vfs_transport_factory': 'vfs'}),
311
            ('int',
312
             {'bzrdir_format': 'D',
313
              'repository_format': 1,
314
              'transport_readonly_server': 'readonly',
315
              'transport_server': 'server',
316
              'vfs_transport_factory': 'vfs'})],
317
            vfs_adapter.formats_to_scenarios(formats))
318
2553.2.3 by Robert Collins
Split out the common test scenario support from the repository implementation specific code.
319
320
class TestTestScenarioApplier(TestCase):
321
    """Tests for the test adaption facilities."""
322
323
    def test_adapt_applies_scenarios(self):
324
        from bzrlib.tests.repository_implementations import TestScenarioApplier
325
        input_test = TestTestScenarioApplier("test_adapt_test_to_scenario")
326
        adapter = TestScenarioApplier()
327
        adapter.scenarios = [("1", "dict"), ("2", "settings")]
328
        calls = []
329
        def capture_call(test, scenario):
330
            calls.append((test, scenario))
331
            return test
332
        adapter.adapt_test_to_scenario = capture_call
333
        adapter.adapt(input_test)
334
        self.assertEqual([(input_test, ("1", "dict")),
335
            (input_test, ("2", "settings"))], calls)
336
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
337
    def test_adapt_test_to_scenario(self):
2553.2.3 by Robert Collins
Split out the common test scenario support from the repository implementation specific code.
338
        from bzrlib.tests.repository_implementations import TestScenarioApplier
339
        input_test = TestTestScenarioApplier("test_adapt_test_to_scenario")
340
        adapter = TestScenarioApplier()
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
341
        # setup two adapted tests
342
        adapted_test1 = adapter.adapt_test_to_scenario(input_test,
343
            ("new id",
344
            {"bzrdir_format":"bzr_format",
345
             "repository_format":"repo_fmt",
346
             "transport_server":"transport_server",
347
             "transport_readonly_server":"readonly-server"}))
348
        adapted_test2 = adapter.adapt_test_to_scenario(input_test,
349
            ("new id 2", {"bzrdir_format":None}))
350
        # input_test should have been altered.
351
        self.assertRaises(AttributeError, getattr, input_test, "bzrdir_format")
352
        # the new tests are mutually incompatible, ensuring it has 
353
        # made new ones, and unspecified elements in the scenario
354
        # should not have been altered.
355
        self.assertEqual("bzr_format", adapted_test1.bzrdir_format)
356
        self.assertEqual("repo_fmt", adapted_test1.repository_format)
357
        self.assertEqual("transport_server", adapted_test1.transport_server)
358
        self.assertEqual("readonly-server",
359
            adapted_test1.transport_readonly_server)
360
        self.assertEqual(
2553.2.3 by Robert Collins
Split out the common test scenario support from the repository implementation specific code.
361
            "bzrlib.tests.test_selftest.TestTestScenarioApplier."
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
362
            "test_adapt_test_to_scenario(new id)",
363
            adapted_test1.id())
364
        self.assertEqual(None, adapted_test2.bzrdir_format)
365
        self.assertEqual(
2553.2.3 by Robert Collins
Split out the common test scenario support from the repository implementation specific code.
366
            "bzrlib.tests.test_selftest.TestTestScenarioApplier."
2553.2.1 by Robert Collins
Overhaul RepositoryTestAdapter to be cleaner and more modular.
367
            "test_adapt_test_to_scenario(new id 2)",
368
            adapted_test2.id())
2018.5.64 by Robert Collins
Allow Repository tests to be backed onto a specific VFS as needed.
369
1534.4.40 by Robert Collins
Add RepositoryFormats and allow bzrdir.open or create _repository to be used.
370
1534.1.29 by Robert Collins
Add a test environment for InterRepository objects, and remove the fetch corner case tests from test_repository.
371
class TestInterRepositoryProviderAdapter(TestCase):
372
    """A group of tests that test the InterRepository test adapter."""
373
374
    def test_adapted_tests(self):
375
        # check that constructor parameters are passed through to the adapted
376
        # test.
2553.2.4 by Robert Collins
Treat InterRepositoryTestProviderAdapter like RepositoryTestProviderAdapter
377
        from bzrlib.tests.interrepository_implementations import \
378
            InterRepositoryTestProviderAdapter
1534.1.29 by Robert Collins
Add a test environment for InterRepository objects, and remove the fetch corner case tests from test_repository.
379
        server1 = "a"
380
        server2 = "b"
1563.2.20 by Robert Collins
Add a revision store test adapter.
381
        formats = [(str, "C1", "C2"), (int, "D1", "D2")]
1534.1.29 by Robert Collins
Add a test environment for InterRepository objects, and remove the fetch corner case tests from test_repository.
382
        adapter = InterRepositoryTestProviderAdapter(server1, server2, formats)
2553.2.4 by Robert Collins
Treat InterRepositoryTestProviderAdapter like RepositoryTestProviderAdapter
383
        self.assertEqual([
3302.5.4 by Vincent Ladeuil
Make interreop parametrized tests IDs unique.
384
            ('str,str,str',
2553.2.4 by Robert Collins
Treat InterRepositoryTestProviderAdapter like RepositoryTestProviderAdapter
385
             {'interrepo_class': str,
386
              'repository_format': 'C1',
387
              'repository_format_to': 'C2',
388
              'transport_readonly_server': 'b',
389
              'transport_server': 'a'}),
3302.5.4 by Vincent Ladeuil
Make interreop parametrized tests IDs unique.
390
            ('int,str,str',
2553.2.4 by Robert Collins
Treat InterRepositoryTestProviderAdapter like RepositoryTestProviderAdapter
391
             {'interrepo_class': int,
392
              'repository_format': 'D1',
393
              'repository_format_to': 'D2',
394
              'transport_readonly_server': 'b',
395
              'transport_server': 'a'})],
396
            adapter.formats_to_scenarios(formats))
1534.1.29 by Robert Collins
Add a test environment for InterRepository objects, and remove the fetch corner case tests from test_repository.
397
398
1534.4.46 by Robert Collins
Nearly complete .bzr/checkout splitout.
399
class TestWorkingTreeProviderAdapter(TestCase):
400
    """A group of tests that test the workingtree implementation test adapter."""
401
2553.2.10 by Robert Collins
And overhaul WorkingTreeTestProviderAdapter too.
402
    def test_scenarios(self):
1534.4.46 by Robert Collins
Nearly complete .bzr/checkout splitout.
403
        # check that constructor parameters are passed through to the adapted
404
        # test.
2553.2.10 by Robert Collins
And overhaul WorkingTreeTestProviderAdapter too.
405
        from bzrlib.tests.workingtree_implementations \
406
            import WorkingTreeTestProviderAdapter
1534.4.46 by Robert Collins
Nearly complete .bzr/checkout splitout.
407
        server1 = "a"
408
        server2 = "b"
409
        formats = [("c", "C"), ("d", "D")]
410
        adapter = WorkingTreeTestProviderAdapter(server1, server2, formats)
2553.2.10 by Robert Collins
And overhaul WorkingTreeTestProviderAdapter too.
411
        self.assertEqual([
412
            ('str',
413
             {'bzrdir_format': 'C',
414
              'transport_readonly_server': 'b',
415
              'transport_server': 'a',
416
              'workingtree_format': 'c'}),
417
            ('str',
418
             {'bzrdir_format': 'D',
419
              'transport_readonly_server': 'b',
420
              'transport_server': 'a',
421
              'workingtree_format': 'd'})],
422
            adapter.scenarios)
1534.4.46 by Robert Collins
Nearly complete .bzr/checkout splitout.
423
424
1852.6.1 by Robert Collins
Start tree implementation tests.
425
class TestTreeProviderAdapter(TestCase):
426
    """Test the setup of tree_implementation tests."""
427
428
    def test_adapted_tests(self):
429
        # the tree implementation adapter is meant to setup one instance for
430
        # each working tree format, and one additional instance that will
431
        # use the default wt format, but create a revision tree for the tests.
432
        # this means that the wt ones should have the workingtree_to_test_tree
433
        # attribute set to 'return_parameter' and the revision one set to
434
        # revision_tree_from_workingtree.
435
436
        from bzrlib.tests.tree_implementations import (
437
            TreeTestProviderAdapter,
438
            return_parameter,
439
            revision_tree_from_workingtree
440
            )
2255.2.164 by Martin Pool
Change the default format for some tests from AB1 back to WorkingTreeFormat3
441
        from bzrlib.workingtree import WorkingTreeFormat, WorkingTreeFormat3
1852.6.1 by Robert Collins
Start tree implementation tests.
442
        input_test = TestTreeProviderAdapter(
443
            "test_adapted_tests")
444
        server1 = "a"
445
        server2 = "b"
446
        formats = [("c", "C"), ("d", "D")]
447
        adapter = TreeTestProviderAdapter(server1, server2, formats)
448
        suite = adapter.adapt(input_test)
449
        tests = list(iter(suite))
3363.2.6 by Aaron Bentley
Fix adatation test
450
        # XXX We should not have tests fail as we add more scenarios
451
        # abentley 20080412
452
        self.assertEqual(5, len(tests))
2255.2.164 by Martin Pool
Change the default format for some tests from AB1 back to WorkingTreeFormat3
453
        # this must match the default format setp up in
454
        # TreeTestProviderAdapter.adapt
455
        default_format = WorkingTreeFormat3
1852.6.1 by Robert Collins
Start tree implementation tests.
456
        self.assertEqual(tests[0].workingtree_format, formats[0][0])
457
        self.assertEqual(tests[0].bzrdir_format, formats[0][1])
458
        self.assertEqual(tests[0].transport_server, server1)
459
        self.assertEqual(tests[0].transport_readonly_server, server2)
3363.1.5 by Aaron Bentley
Update tests
460
        self.assertEqual(tests[0]._workingtree_to_test_tree, return_parameter)
1852.6.1 by Robert Collins
Start tree implementation tests.
461
        self.assertEqual(tests[1].workingtree_format, formats[1][0])
462
        self.assertEqual(tests[1].bzrdir_format, formats[1][1])
463
        self.assertEqual(tests[1].transport_server, server1)
464
        self.assertEqual(tests[1].transport_readonly_server, server2)
3363.1.5 by Aaron Bentley
Update tests
465
        self.assertEqual(tests[1]._workingtree_to_test_tree, return_parameter)
2100.3.20 by Aaron Bentley
Implement tree comparison for tree references
466
        self.assertIsInstance(tests[2].workingtree_format, default_format)
467
        #self.assertEqual(tests[2].bzrdir_format,
468
        #                 default_format._matchingbzrdir)
1852.6.1 by Robert Collins
Start tree implementation tests.
469
        self.assertEqual(tests[2].transport_server, server1)
470
        self.assertEqual(tests[2].transport_readonly_server, server2)
3363.1.5 by Aaron Bentley
Update tests
471
        self.assertEqual(tests[2]._workingtree_to_test_tree,
1852.6.1 by Robert Collins
Start tree implementation tests.
472
            revision_tree_from_workingtree)
473
474
1852.8.3 by Robert Collins
Implement an InterTreeTestProvider and a trivial test_compare test case.
475
class TestInterTreeProviderAdapter(TestCase):
476
    """A group of tests that test the InterTreeTestAdapter."""
477
478
    def test_adapted_tests(self):
479
        # check that constructor parameters are passed through to the adapted
480
        # test.
481
        # for InterTree tests we want the machinery to bring up two trees in
482
        # each instance: the base one, and the one we are interacting with.
483
        # because each optimiser can be direction specific, we need to test
484
        # each optimiser in its chosen direction.
485
        # unlike the TestProviderAdapter we dont want to automatically add a
3128.1.3 by Vincent Ladeuil
Since we are there s/parameteris.*/parameteriz&/.
486
        # parameterized one for WorkingTree - the optimisers will tell us what
1852.8.3 by Robert Collins
Implement an InterTreeTestProvider and a trivial test_compare test case.
487
        # ones to add.
488
        from bzrlib.tests.tree_implementations import (
489
            return_parameter,
490
            revision_tree_from_workingtree
491
            )
492
        from bzrlib.tests.intertree_implementations import (
493
            InterTreeTestProviderAdapter,
494
            )
495
        from bzrlib.workingtree import WorkingTreeFormat2, WorkingTreeFormat3
496
        input_test = TestInterTreeProviderAdapter(
497
            "test_adapted_tests")
498
        server1 = "a"
499
        server2 = "b"
500
        format1 = WorkingTreeFormat2()
501
        format2 = WorkingTreeFormat3()
2255.2.122 by Robert Collins
Alter intertree implementation tests to let dirstate inter-trees be correctly parameterised.
502
        formats = [(str, format1, format2, "converter1"),
503
            (int, format2, format1, "converter2")]
1852.8.3 by Robert Collins
Implement an InterTreeTestProvider and a trivial test_compare test case.
504
        adapter = InterTreeTestProviderAdapter(server1, server2, formats)
505
        suite = adapter.adapt(input_test)
506
        tests = list(iter(suite))
507
        self.assertEqual(2, len(tests))
508
        self.assertEqual(tests[0].intertree_class, formats[0][0])
509
        self.assertEqual(tests[0].workingtree_format, formats[0][1])
2255.2.122 by Robert Collins
Alter intertree implementation tests to let dirstate inter-trees be correctly parameterised.
510
        self.assertEqual(tests[0].workingtree_format_to, formats[0][2])
511
        self.assertEqual(tests[0].mutable_trees_to_test_trees, formats[0][3])
3363.1.5 by Aaron Bentley
Update tests
512
        self.assertEqual(tests[0]._workingtree_to_test_tree, return_parameter)
1852.8.3 by Robert Collins
Implement an InterTreeTestProvider and a trivial test_compare test case.
513
        self.assertEqual(tests[0].transport_server, server1)
514
        self.assertEqual(tests[0].transport_readonly_server, server2)
515
        self.assertEqual(tests[1].intertree_class, formats[1][0])
516
        self.assertEqual(tests[1].workingtree_format, formats[1][1])
2255.2.122 by Robert Collins
Alter intertree implementation tests to let dirstate inter-trees be correctly parameterised.
517
        self.assertEqual(tests[1].workingtree_format_to, formats[1][2])
518
        self.assertEqual(tests[1].mutable_trees_to_test_trees, formats[1][3])
3363.1.5 by Aaron Bentley
Update tests
519
        self.assertEqual(tests[1]._workingtree_to_test_tree, return_parameter)
1852.8.3 by Robert Collins
Implement an InterTreeTestProvider and a trivial test_compare test case.
520
        self.assertEqual(tests[1].transport_server, server1)
521
        self.assertEqual(tests[1].transport_readonly_server, server2)
522
1987.1.1 by John Arbash Meinel
Update the test suite to put HOME in a different directory
523
524
class TestTestCaseInTempDir(TestCaseInTempDir):
525
526
    def test_home_is_not_working(self):
527
        self.assertNotEqual(self.test_dir, self.test_home_dir)
528
        cwd = osutils.getcwd()
2823.1.4 by Vincent Ladeuil
Use assertIsSameRealPath to avoid OSX aliasing (specifically /tmp
529
        self.assertIsSameRealPath(self.test_dir, cwd)
530
        self.assertIsSameRealPath(self.test_home_dir, os.environ['HOME'])
1987.1.1 by John Arbash Meinel
Update the test suite to put HOME in a different directory
531
532
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
533
class TestTestCaseWithMemoryTransport(TestCaseWithMemoryTransport):
534
535
    def test_home_is_non_existant_dir_under_root(self):
536
        """The test_home_dir for TestCaseWithMemoryTransport is missing.
537
538
        This is because TestCaseWithMemoryTransport is for tests that do not
539
        need any disk resources: they should be hooked into bzrlib in such a 
540
        way that no global settings are being changed by the test (only a 
541
        few tests should need to do that), and having a missing dir as home is
542
        an effective way to ensure that this is the case.
543
        """
2823.1.4 by Vincent Ladeuil
Use assertIsSameRealPath to avoid OSX aliasing (specifically /tmp
544
        self.assertIsSameRealPath(
545
            self.TEST_ROOT + "/MemoryTransportMissingHomeDir",
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
546
            self.test_home_dir)
2823.1.4 by Vincent Ladeuil
Use assertIsSameRealPath to avoid OSX aliasing (specifically /tmp
547
        self.assertIsSameRealPath(self.test_home_dir, os.environ['HOME'])
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
548
        
549
    def test_cwd_is_TEST_ROOT(self):
2823.1.4 by Vincent Ladeuil
Use assertIsSameRealPath to avoid OSX aliasing (specifically /tmp
550
        self.assertIsSameRealPath(self.test_dir, self.TEST_ROOT)
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
551
        cwd = osutils.getcwd()
2823.1.4 by Vincent Ladeuil
Use assertIsSameRealPath to avoid OSX aliasing (specifically /tmp
552
        self.assertIsSameRealPath(self.test_dir, cwd)
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
553
554
    def test_make_branch_and_memory_tree(self):
555
        """In TestCaseWithMemoryTransport we should not make the branch on disk.
556
557
        This is hard to comprehensively robustly test, so we settle for making
558
        a branch and checking no directory was created at its relpath.
559
        """
560
        tree = self.make_branch_and_memory_tree('dir')
2227.2.2 by v.ladeuil+lp at free
Cleanup.
561
        # Guard against regression into MemoryTransport leaking
562
        # files to disk instead of keeping them in memory.
563
        self.failIf(osutils.lexists('dir'))
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
564
        self.assertIsInstance(tree, memorytree.MemoryTree)
565
1986.4.9 by Robert Collins
``TestCase.make_branch_and_memory_tree`` now takes a format
566
    def test_make_branch_and_memory_tree_with_format(self):
567
        """make_branch_and_memory_tree should accept a format option."""
568
        format = bzrdir.BzrDirMetaFormat1()
2241.1.4 by Martin Pool
Moved old weave-based repository formats into bzrlib.repofmt.weaverepo.
569
        format.repository_format = weaverepo.RepositoryFormat7()
1986.4.9 by Robert Collins
``TestCase.make_branch_and_memory_tree`` now takes a format
570
        tree = self.make_branch_and_memory_tree('dir', format=format)
2227.2.2 by v.ladeuil+lp at free
Cleanup.
571
        # Guard against regression into MemoryTransport leaking
572
        # files to disk instead of keeping them in memory.
573
        self.failIf(osutils.lexists('dir'))
1986.4.9 by Robert Collins
``TestCase.make_branch_and_memory_tree`` now takes a format
574
        self.assertIsInstance(tree, memorytree.MemoryTree)
575
        self.assertEqual(format.repository_format.__class__,
576
            tree.branch.repository._format.__class__)
577
2875.1.1 by Vincent Ladeuil
Fix #147986 by monitoring a safety .bzr directory.
578
    def test_safety_net(self):
579
        """No test should modify the safety .bzr directory.
580
581
        We just test that the _check_safety_net private method raises
2875.1.2 by Vincent Ladeuil
Update NEWS, fix typo.
582
        AssertionError, it's easier than building a test suite with the same
2875.1.1 by Vincent Ladeuil
Fix #147986 by monitoring a safety .bzr directory.
583
        test.
584
        """
585
        # Oops, a commit in the current directory (i.e. without local .bzr
586
        # directory) will crawl up the hierarchy to find a .bzr directory.
587
        self.run_bzr(['commit', '-mfoo', '--unchanged'])
588
        # But we have a safety net in place.
589
        self.assertRaises(AssertionError, self._check_safety_net)
590
1986.2.3 by Robert Collins
New test base class TestCaseWithMemoryTransport offers memory-only
591
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
592
class TestTestCaseWithTransport(TestCaseWithTransport):
593
    """Tests for the convenience functions TestCaseWithTransport introduces."""
594
595
    def test_get_readonly_url_none(self):
596
        from bzrlib.transport import get_transport
597
        from bzrlib.transport.memory import MemoryServer
598
        from bzrlib.transport.readonly import ReadonlyTransportDecorator
2018.5.42 by Robert Collins
Various hopefully improvements, but wsgi is broken, handing over to spiv :).
599
        self.vfs_transport_factory = MemoryServer
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
600
        self.transport_readonly_server = None
601
        # calling get_readonly_transport() constructs a decorator on the url
602
        # for the server
603
        url = self.get_readonly_url()
1534.4.11 by Robert Collins
Convert test_open_containing from being a Remote test to being the more accurate Chrooted test.
604
        url2 = self.get_readonly_url('foo/bar')
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
605
        t = get_transport(url)
1534.4.11 by Robert Collins
Convert test_open_containing from being a Remote test to being the more accurate Chrooted test.
606
        t2 = get_transport(url2)
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
607
        self.failUnless(isinstance(t, ReadonlyTransportDecorator))
1534.4.11 by Robert Collins
Convert test_open_containing from being a Remote test to being the more accurate Chrooted test.
608
        self.failUnless(isinstance(t2, ReadonlyTransportDecorator))
609
        self.assertEqual(t2.base[:-1], t.abspath('foo/bar'))
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
610
611
    def test_get_readonly_url_http(self):
3102.1.1 by Vincent Ladeuil
Rename bzrlib/test/HTTPTestUtils.py to bzrlib/tests/http_utils.py and fix
612
        from bzrlib.tests.http_server import HttpServer
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
613
        from bzrlib.transport import get_transport
1951.2.1 by Martin Pool
Change to using LocalURLServer for testing.
614
        from bzrlib.transport.local import LocalURLServer
2004.1.25 by v.ladeuil+lp at free
Shuffle http related test code. Hopefully it ends up at the right place :)
615
        from bzrlib.transport.http import HttpTransportBase
1951.2.1 by Martin Pool
Change to using LocalURLServer for testing.
616
        self.transport_server = LocalURLServer
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
617
        self.transport_readonly_server = HttpServer
618
        # calling get_readonly_transport() gives us a HTTP server instance.
619
        url = self.get_readonly_url()
1534.4.11 by Robert Collins
Convert test_open_containing from being a Remote test to being the more accurate Chrooted test.
620
        url2 = self.get_readonly_url('foo/bar')
1540.3.6 by Martin Pool
[merge] update from bzr.dev
621
        # the transport returned may be any HttpTransportBase subclass
1534.4.10 by Robert Collins
Add TestCaseWithTransport class that provides tests with read and write transport pairs.
622
        t = get_transport(url)
1534.4.11 by Robert Collins
Convert test_open_containing from being a Remote test to being the more accurate Chrooted test.
623
        t2 = get_transport(url2)
1540.3.6 by Martin Pool
[merge] update from bzr.dev
624
        self.failUnless(isinstance(t, HttpTransportBase))
625
        self.failUnless(isinstance(t2, HttpTransportBase))
1534.4.11 by Robert Collins
Convert test_open_containing from being a Remote test to being the more accurate Chrooted test.
626
        self.assertEqual(t2.base[:-1], t.abspath('foo/bar'))
1534.4.31 by Robert Collins
cleanedup test_outside_wt
627
1553.5.68 by Martin Pool
Add new TestCaseWithTransport.assertIsDirectory() and tests
628
    def test_is_directory(self):
629
        """Test assertIsDirectory assertion"""
630
        t = self.get_transport()
631
        self.build_tree(['a_dir/', 'a_file'], transport=t)
632
        self.assertIsDirectory('a_dir', t)
633
        self.assertRaises(AssertionError, self.assertIsDirectory, 'a_file', t)
634
        self.assertRaises(AssertionError, self.assertIsDirectory, 'not_here', t)
1534.4.31 by Robert Collins
cleanedup test_outside_wt
635
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
636
1910.13.1 by Andrew Bennetts
Make make_bzrdir preserve the transport.
637
class TestTestCaseTransports(TestCaseWithTransport):
638
639
    def setUp(self):
640
        super(TestTestCaseTransports, self).setUp()
2018.5.42 by Robert Collins
Various hopefully improvements, but wsgi is broken, handing over to spiv :).
641
        self.vfs_transport_factory = MemoryServer
1910.13.1 by Andrew Bennetts
Make make_bzrdir preserve the transport.
642
643
    def test_make_bzrdir_preserves_transport(self):
644
        t = self.get_transport()
645
        result_bzrdir = self.make_bzrdir('subdir')
646
        self.assertIsInstance(result_bzrdir.transport, 
647
                              MemoryTransport)
648
        # should not be on disk, should only be in memory
649
        self.failIfExists('subdir')
650
651
1534.4.31 by Robert Collins
cleanedup test_outside_wt
652
class TestChrootedTest(ChrootedTestCase):
653
654
    def test_root_is_root(self):
655
        from bzrlib.transport import get_transport
656
        t = get_transport(self.get_readonly_url())
657
        url = t.base
658
        self.assertEqual(url, t.clone('..').base)
1540.3.22 by Martin Pool
[patch] Add TestCase.assertIsInstance
659
660
1534.11.1 by Robert Collins
Teach bzr selftest to use a progress bar in non verbose mode.
661
class MockProgress(_BaseProgressBar):
662
    """Progress-bar standin that records calls.
663
664
    Useful for testing pb using code.
665
    """
666
667
    def __init__(self):
668
        _BaseProgressBar.__init__(self)
669
        self.calls = []
670
671
    def tick(self):
672
        self.calls.append(('tick',))
673
674
    def update(self, msg=None, current=None, total=None):
675
        self.calls.append(('update', msg, current, total))
676
677
    def clear(self):
678
        self.calls.append(('clear',))
679
1864.3.1 by John Arbash Meinel
Print out when a test fails in non verbose mode, run transport tests later
680
    def note(self, msg, *args):
681
        self.calls.append(('note', msg, args))
682
1534.11.1 by Robert Collins
Teach bzr selftest to use a progress bar in non verbose mode.
683
1725.1.1 by Robert Collins
'bzr selftest --benchmark --lsprof-timed' will use lsprofile to generate
684
class TestTestResult(TestCase):
1534.11.1 by Robert Collins
Teach bzr selftest to use a progress bar in non verbose mode.
685
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
686
    def check_timing(self, test_case, expected_re):
2095.4.1 by Martin Pool
Better progress bars during tests
687
        result = bzrlib.tests.TextTestResult(self._log_file,
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
688
                descriptions=0,
689
                verbosity=1,
690
                )
691
        test_case.run(result)
692
        timed_string = result._testTimeString(test_case)
693
        self.assertContainsRe(timed_string, expected_re)
694
695
    def test_test_reporting(self):
696
        class ShortDelayTestCase(TestCase):
697
            def test_short_delay(self):
698
                time.sleep(0.003)
699
            def test_short_benchmark(self):
700
                self.time(time.sleep, 0.003)
701
        self.check_timing(ShortDelayTestCase('test_short_delay'),
702
                          r"^ +[0-9]+ms$")
1707.2.3 by Robert Collins
Add a setBenchmarkTime method to the bzrlib test result allowing introduction of granular benchmarking. (Robert Collins, Martin Pool).
703
        # if a benchmark time is given, we want a x of y style result.
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
704
        self.check_timing(ShortDelayTestCase('test_short_benchmark'),
705
                          r"^ +[0-9]+ms/ +[0-9]+ms$")
1707.2.3 by Robert Collins
Add a setBenchmarkTime method to the bzrlib test result allowing introduction of granular benchmarking. (Robert Collins, Martin Pool).
706
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
707
    def test_unittest_reporting_unittest_class(self):
708
        # getting the time from a non-bzrlib test works ok
709
        class ShortDelayTestCase(unittest.TestCase):
710
            def test_short_delay(self):
711
                time.sleep(0.003)
712
        self.check_timing(ShortDelayTestCase('test_short_delay'),
713
                          r"^ +[0-9]+ms$")
714
        
1819.1.1 by Carl Friedrich Bolz
(lifeless, cfbolz, hpk): Give the test result object an optional benchmark
715
    def test_assigned_benchmark_file_stores_date(self):
716
        output = StringIO()
2095.4.1 by Martin Pool
Better progress bars during tests
717
        result = bzrlib.tests.TextTestResult(self._log_file,
1819.1.1 by Carl Friedrich Bolz
(lifeless, cfbolz, hpk): Give the test result object an optional benchmark
718
                                        descriptions=0,
719
                                        verbosity=1,
720
                                        bench_history=output
721
                                        )
722
        output_string = output.getvalue()
1819.1.4 by Jan Balster
save the revison id for every benchmark run in .perf-history
723
        # if you are wondering about the regexp please read the comment in
724
        # test_bench_history (bzrlib.tests.test_selftest.TestRunner)
1951.1.2 by Andrew Bennetts
Relax test_assigned_benchmark_file_stores_date's regexp the same way we relaxed test_bench_history's.
725
        # XXX: what comment?  -- Andrew Bennetts
726
        self.assertContainsRe(output_string, "--date [0-9.]+")
1819.1.3 by Carl Friedrich Bolz
(lifeless, cfbolz): Add recording of benchmark results to the benchmark history
727
728
    def test_benchhistory_records_test_times(self):
729
        result_stream = StringIO()
2095.4.1 by Martin Pool
Better progress bars during tests
730
        result = bzrlib.tests.TextTestResult(
1819.1.3 by Carl Friedrich Bolz
(lifeless, cfbolz): Add recording of benchmark results to the benchmark history
731
            self._log_file,
732
            descriptions=0,
733
            verbosity=1,
734
            bench_history=result_stream
735
            )
736
737
        # we want profile a call and check that its test duration is recorded
738
        # make a new test instance that when run will generate a benchmark
739
        example_test_case = TestTestResult("_time_hello_world_encoding")
740
        # execute the test, which should succeed and record times
741
        example_test_case.run(result)
742
        lines = result_stream.getvalue().splitlines()
743
        self.assertEqual(2, len(lines))
744
        self.assertContainsRe(lines[1],
745
            " *[0-9]+ms bzrlib.tests.test_selftest.TestTestResult"
746
            "._time_hello_world_encoding")
747
 
1725.1.1 by Robert Collins
'bzr selftest --benchmark --lsprof-timed' will use lsprofile to generate
748
    def _time_hello_world_encoding(self):
749
        """Profile two sleep calls
750
        
751
        This is used to exercise the test framework.
752
        """
753
        self.time(unicode, 'hello', errors='replace')
754
        self.time(unicode, 'world', errors='replace')
755
756
    def test_lsprofiling(self):
757
        """Verbose test result prints lsprof statistics from test cases."""
1551.15.28 by Aaron Bentley
Improve Feature usage style w/ lsprof
758
        self.requireFeature(test_lsprof.LSProfFeature)
1725.1.1 by Robert Collins
'bzr selftest --benchmark --lsprof-timed' will use lsprofile to generate
759
        result_stream = StringIO()
2095.4.1 by Martin Pool
Better progress bars during tests
760
        result = bzrlib.tests.VerboseTestResult(
1725.1.1 by Robert Collins
'bzr selftest --benchmark --lsprof-timed' will use lsprofile to generate
761
            unittest._WritelnDecorator(result_stream),
762
            descriptions=0,
763
            verbosity=2,
764
            )
765
        # we want profile a call of some sort and check it is output by
766
        # addSuccess. We dont care about addError or addFailure as they
767
        # are not that interesting for performance tuning.
768
        # make a new test instance that when run will generate a profile
769
        example_test_case = TestTestResult("_time_hello_world_encoding")
770
        example_test_case._gather_lsprof_in_benchmarks = True
771
        # execute the test, which should succeed and record profiles
772
        example_test_case.run(result)
773
        # lsprofile_something()
774
        # if this worked we want 
775
        # LSProf output for <built in function unicode> (['hello'], {'errors': 'replace'})
776
        #    CallCount    Recursive    Total(ms)   Inline(ms) module:lineno(function)
777
        # (the lsprof header)
778
        # ... an arbitrary number of lines
779
        # and the function call which is time.sleep.
780
        #           1        0            ???         ???       ???(sleep) 
781
        # and then repeated but with 'world', rather than 'hello'.
782
        # this should appear in the output stream of our test result.
1831.2.1 by Martin Pool
[trivial] Simplify & fix up lsprof blackbox test
783
        output = result_stream.getvalue()
784
        self.assertContainsRe(output,
785
            r"LSProf output for <type 'unicode'>\(\('hello',\), {'errors': 'replace'}\)")
786
        self.assertContainsRe(output,
787
            r" *CallCount *Recursive *Total\(ms\) *Inline\(ms\) *module:lineno\(function\)\n")
788
        self.assertContainsRe(output,
789
            r"( +1 +0 +0\.\d+ +0\.\d+ +<method 'disable' of '_lsprof\.Profiler' objects>\n)?")
790
        self.assertContainsRe(output,
791
            r"LSProf output for <type 'unicode'>\(\('world',\), {'errors': 'replace'}\)\n")
1725.1.1 by Robert Collins
'bzr selftest --benchmark --lsprof-timed' will use lsprofile to generate
792
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
793
    def test_known_failure(self):
794
        """A KnownFailure being raised should trigger several result actions."""
795
        class InstrumentedTestResult(ExtendedTestResult):
796
797
            def report_test_start(self, test): pass
798
            def report_known_failure(self, test, err):
799
                self._call = test, err
800
        result = InstrumentedTestResult(None, None, None, None)
801
        def test_function():
802
            raise KnownFailure('failed!')
803
        test = unittest.FunctionTestCase(test_function)
804
        test.run(result)
805
        # it should invoke 'report_known_failure'.
806
        self.assertEqual(2, len(result._call))
807
        self.assertEqual(test, result._call[0])
808
        self.assertEqual(KnownFailure, result._call[1][0])
809
        self.assertIsInstance(result._call[1][1], KnownFailure)
810
        # we dont introspec the traceback, if the rest is ok, it would be
811
        # exceptional for it not to be.
812
        # it should update the known_failure_count on the object.
813
        self.assertEqual(1, result.known_failure_count)
814
        # the result should be successful.
815
        self.assertTrue(result.wasSuccessful())
816
817
    def test_verbose_report_known_failure(self):
818
        # verbose test output formatting
819
        result_stream = StringIO()
820
        result = bzrlib.tests.VerboseTestResult(
821
            unittest._WritelnDecorator(result_stream),
822
            descriptions=0,
823
            verbosity=2,
824
            )
825
        test = self.get_passing_test()
826
        result.startTest(test)
827
        prefix = len(result_stream.getvalue())
828
        # the err parameter has the shape:
829
        # (class, exception object, traceback)
830
        # KnownFailures dont get their tracebacks shown though, so we
831
        # can skip that.
832
        err = (KnownFailure, KnownFailure('foo'), None)
833
        result.report_known_failure(test, err)
834
        output = result_stream.getvalue()[prefix:]
835
        lines = output.splitlines()
2418.3.1 by John Arbash Meinel
Remove timing dependencies from the selftest tests.
836
        self.assertContainsRe(lines[0], r'XFAIL *\d+ms$')
837
        self.assertEqual(lines[1], '    foo')
838
        self.assertEqual(2, len(lines))
839
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
840
    def test_text_report_known_failure(self):
841
        # text test output formatting
842
        pb = MockProgress()
843
        result = bzrlib.tests.TextTestResult(
844
            None,
845
            descriptions=0,
846
            verbosity=1,
847
            pb=pb,
848
            )
849
        test = self.get_passing_test()
850
        # this seeds the state to handle reporting the test.
851
        result.startTest(test)
852
        # the err parameter has the shape:
853
        # (class, exception object, traceback)
854
        # KnownFailures dont get their tracebacks shown though, so we
855
        # can skip that.
856
        err = (KnownFailure, KnownFailure('foo'), None)
857
        result.report_known_failure(test, err)
858
        self.assertEqual(
859
            [
860
            ('update', '[1 in 0s] passing_test', None, None),
861
            ('note', 'XFAIL: %s\n%s\n', ('passing_test', err[1]))
862
            ],
863
            pb.calls)
864
        # known_failures should be printed in the summary, so if we run a test
865
        # after there are some known failures, the update prefix should match
866
        # this.
867
        result.known_failure_count = 3
868
        test.run(result)
869
        self.assertEqual(
870
            [
3297.1.3 by Martin Pool
Fix up selftest progress tests
871
            ('update', '[2 in 0s] passing_test', None, None),
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
872
            ],
873
            pb.calls[2:])
874
875
    def get_passing_test(self):
876
        """Return a test object that can't be run usefully."""
877
        def passing_test():
878
            pass
879
        return unittest.FunctionTestCase(passing_test)
880
2367.1.5 by Robert Collins
Implement reporting of Unsupported tests in the bzr test result and runner
881
    def test_add_not_supported(self):
882
        """Test the behaviour of invoking addNotSupported."""
883
        class InstrumentedTestResult(ExtendedTestResult):
884
            def report_test_start(self, test): pass
885
            def report_unsupported(self, test, feature):
886
                self._call = test, feature
887
        result = InstrumentedTestResult(None, None, None, None)
888
        test = SampleTestCase('_test_pass')
889
        feature = Feature()
890
        result.startTest(test)
891
        result.addNotSupported(test, feature)
892
        # it should invoke 'report_unsupported'.
893
        self.assertEqual(2, len(result._call))
894
        self.assertEqual(test, result._call[0])
895
        self.assertEqual(feature, result._call[1])
896
        # the result should be successful.
897
        self.assertTrue(result.wasSuccessful())
898
        # it should record the test against a count of tests not run due to
899
        # this feature.
900
        self.assertEqual(1, result.unsupported['Feature'])
901
        # and invoking it again should increment that counter
902
        result.addNotSupported(test, feature)
903
        self.assertEqual(2, result.unsupported['Feature'])
904
905
    def test_verbose_report_unsupported(self):
906
        # verbose test output formatting
907
        result_stream = StringIO()
908
        result = bzrlib.tests.VerboseTestResult(
909
            unittest._WritelnDecorator(result_stream),
910
            descriptions=0,
911
            verbosity=2,
912
            )
913
        test = self.get_passing_test()
914
        feature = Feature()
915
        result.startTest(test)
916
        prefix = len(result_stream.getvalue())
917
        result.report_unsupported(test, feature)
918
        output = result_stream.getvalue()[prefix:]
919
        lines = output.splitlines()
920
        self.assertEqual(lines, ['NODEP                   0ms', "    The feature 'Feature' is not available."])
921
    
922
    def test_text_report_unsupported(self):
923
        # text test output formatting
924
        pb = MockProgress()
925
        result = bzrlib.tests.TextTestResult(
926
            None,
927
            descriptions=0,
928
            verbosity=1,
929
            pb=pb,
930
            )
931
        test = self.get_passing_test()
932
        feature = Feature()
933
        # this seeds the state to handle reporting the test.
934
        result.startTest(test)
935
        result.report_unsupported(test, feature)
936
        # no output on unsupported features
937
        self.assertEqual(
938
            [('update', '[1 in 0s] passing_test', None, None)
939
            ],
940
            pb.calls)
941
        # the number of missing features should be printed in the progress
942
        # summary, so check for that.
943
        result.unsupported = {'foo':0, 'bar':0}
944
        test.run(result)
945
        self.assertEqual(
946
            [
3297.1.3 by Martin Pool
Fix up selftest progress tests
947
            ('update', '[2 in 0s, 2 missing] passing_test', None, None),
2367.1.5 by Robert Collins
Implement reporting of Unsupported tests in the bzr test result and runner
948
            ],
949
            pb.calls[1:])
950
    
2367.1.6 by Robert Collins
Allow per-test-fixture feature requirements via 'requireFeature'.(Robert Collins)
951
    def test_unavailable_exception(self):
952
        """An UnavailableFeature being raised should invoke addNotSupported."""
953
        class InstrumentedTestResult(ExtendedTestResult):
954
955
            def report_test_start(self, test): pass
956
            def addNotSupported(self, test, feature):
957
                self._call = test, feature
958
        result = InstrumentedTestResult(None, None, None, None)
959
        feature = Feature()
960
        def test_function():
961
            raise UnavailableFeature(feature)
962
        test = unittest.FunctionTestCase(test_function)
963
        test.run(result)
964
        # it should invoke 'addNotSupported'.
965
        self.assertEqual(2, len(result._call))
966
        self.assertEqual(test, result._call[0])
967
        self.assertEqual(feature, result._call[1])
968
        # and not count as an error
969
        self.assertEqual(0, result.error_count)
970
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
971
    def test_strict_with_unsupported_feature(self):
972
        result = bzrlib.tests.TextTestResult(self._log_file, descriptions=0,
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
973
                                             verbosity=1)
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
974
        test = self.get_passing_test()
975
        feature = "Unsupported Feature"
976
        result.addNotSupported(test, feature)
977
        self.assertFalse(result.wasStrictlySuccessful())
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
978
        self.assertEqual(None, result._extractBenchmarkTime(test))
979
 
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
980
    def test_strict_with_known_failure(self):
981
        result = bzrlib.tests.TextTestResult(self._log_file, descriptions=0,
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
982
                                             verbosity=1)
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
983
        test = self.get_passing_test()
984
        err = (KnownFailure, KnownFailure('foo'), None)
2695.1.1 by Martin Pool
Fix problem if the first test is missing a dependency
985
        result._addKnownFailure(test, err)
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
986
        self.assertFalse(result.wasStrictlySuccessful())
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
987
        self.assertEqual(None, result._extractBenchmarkTime(test))
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
988
989
    def test_strict_with_success(self):
990
        result = bzrlib.tests.TextTestResult(self._log_file, descriptions=0,
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
991
                                             verbosity=1)
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
992
        test = self.get_passing_test()
993
        result.addSuccess(test)
994
        self.assertTrue(result.wasStrictlySuccessful())
2695.1.3 by Martin Pool
Fix up selftest tests for new extractBenchmarkTime behaviour; remove many unneeded calls to it
995
        self.assertEqual(None, result._extractBenchmarkTime(test))
2658.3.2 by Daniel Watkins
Added tests for ExtendedTestResult.wasStrictlySuccessful.
996
1534.11.1 by Robert Collins
Teach bzr selftest to use a progress bar in non verbose mode.
997
998
class TestRunner(TestCase):
999
1000
    def dummy_test(self):
1001
        pass
1002
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
1003
    def run_test_runner(self, testrunner, test):
1004
        """Run suite in testrunner, saving global state and restoring it.
1005
1006
        This current saves and restores:
1007
        TestCaseInTempDir.TEST_ROOT
1008
        
1009
        There should be no tests in this file that use bzrlib.tests.TextTestRunner
1010
        without using this convenience method, because of our use of global state.
1011
        """
1012
        old_root = TestCaseInTempDir.TEST_ROOT
1013
        try:
1014
            TestCaseInTempDir.TEST_ROOT = None
1015
            return testrunner.run(test)
1016
        finally:
1017
            TestCaseInTempDir.TEST_ROOT = old_root
1018
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
1019
    def test_known_failure_failed_run(self):
1020
        # run a test that generates a known failure which should be printed in
1021
        # the final output when real failures occur.
1022
        def known_failure_test():
1023
            raise KnownFailure('failed')
1024
        test = unittest.TestSuite()
1025
        test.addTest(unittest.FunctionTestCase(known_failure_test))
1026
        def failing_test():
1027
            raise AssertionError('foo')
1028
        test.addTest(unittest.FunctionTestCase(failing_test))
1029
        stream = StringIO()
1030
        runner = TextTestRunner(stream=stream)
1031
        result = self.run_test_runner(runner, test)
1032
        lines = stream.getvalue().splitlines()
1033
        self.assertEqual([
1034
            '',
1035
            '======================================================================',
1036
            'FAIL: unittest.FunctionTestCase (failing_test)',
1037
            '----------------------------------------------------------------------',
1038
            'Traceback (most recent call last):',
1039
            '    raise AssertionError(\'foo\')',
1040
            'AssertionError: foo',
1041
            '',
1042
            '----------------------------------------------------------------------',
1043
            '',
1044
            'FAILED (failures=1, known_failure_count=1)'],
2367.1.5 by Robert Collins
Implement reporting of Unsupported tests in the bzr test result and runner
1045
            lines[0:5] + lines[6:10] + lines[11:])
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
1046
1047
    def test_known_failure_ok_run(self):
1048
        # run a test that generates a known failure which should be printed in the final output.
1049
        def known_failure_test():
1050
            raise KnownFailure('failed')
1051
        test = unittest.FunctionTestCase(known_failure_test)
1052
        stream = StringIO()
1053
        runner = TextTestRunner(stream=stream)
1054
        result = self.run_test_runner(runner, test)
2418.3.1 by John Arbash Meinel
Remove timing dependencies from the selftest tests.
1055
        self.assertContainsRe(stream.getvalue(),
1056
            '\n'
1057
            '-*\n'
1058
            'Ran 1 test in .*\n'
1059
            '\n'
1060
            'OK \\(known_failures=1\\)\n')
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
1061
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
1062
    def test_skipped_test(self):
1063
        # run a test that is skipped, and check the suite as a whole still
1064
        # succeeds.
1065
        # skipping_test must be hidden in here so it's not run as a real test
1066
        def skipping_test():
1067
            raise TestSkipped('test intentionally skipped')
2338.4.8 by Marien Zwart
Fix a bug in selftest causing tearDown to run twice for skipped tests.
1068
2485.6.5 by Martin Pool
Remove keep_output option
1069
        runner = TextTestRunner(stream=self._log_file)
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1070
        test = unittest.FunctionTestCase(skipping_test)
1071
        result = self.run_test_runner(runner, test)
1072
        self.assertTrue(result.wasSuccessful())
1073
1074
    def test_skipped_from_setup(self):
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1075
        calls = []
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1076
        class SkippedSetupTest(TestCase):
2338.4.8 by Marien Zwart
Fix a bug in selftest causing tearDown to run twice for skipped tests.
1077
1078
            def setUp(self):
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1079
                calls.append('setUp')
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1080
                self.addCleanup(self.cleanup)
2338.4.8 by Marien Zwart
Fix a bug in selftest causing tearDown to run twice for skipped tests.
1081
                raise TestSkipped('skipped setup')
1082
1083
            def test_skip(self):
1084
                self.fail('test reached')
1085
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1086
            def cleanup(self):
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1087
                calls.append('cleanup')
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1088
2485.6.5 by Martin Pool
Remove keep_output option
1089
        runner = TextTestRunner(stream=self._log_file)
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1090
        test = SkippedSetupTest('test_skip')
1091
        result = self.run_test_runner(runner, test)
1092
        self.assertTrue(result.wasSuccessful())
1093
        # Check if cleanup was called the right number of times.
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1094
        self.assertEqual(['setUp', 'cleanup'], calls)
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1095
1096
    def test_skipped_from_test(self):
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1097
        calls = []
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1098
        class SkippedTest(TestCase):
2338.4.8 by Marien Zwart
Fix a bug in selftest causing tearDown to run twice for skipped tests.
1099
1100
            def setUp(self):
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1101
                calls.append('setUp')
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1102
                self.addCleanup(self.cleanup)
2338.4.8 by Marien Zwart
Fix a bug in selftest causing tearDown to run twice for skipped tests.
1103
1104
            def test_skip(self):
1105
                raise TestSkipped('skipped test')
1106
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1107
            def cleanup(self):
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1108
                calls.append('cleanup')
2338.4.8 by Marien Zwart
Fix a bug in selftest causing tearDown to run twice for skipped tests.
1109
2485.6.5 by Martin Pool
Remove keep_output option
1110
        runner = TextTestRunner(stream=self._log_file)
2338.4.8 by Marien Zwart
Fix a bug in selftest causing tearDown to run twice for skipped tests.
1111
        test = SkippedTest('test_skip')
1112
        result = self.run_test_runner(runner, test)
1113
        self.assertTrue(result.wasSuccessful())
2338.4.10 by Marien Zwart
Make a test skipped from setUp run tearDown again. Make calling _runCleanups twice safe. Clean up tests.
1114
        # Check if cleanup was called the right number of times.
3224.4.1 by Andrew Bennetts
Prune __dict__ of TestCases after they have run to save memory.
1115
        self.assertEqual(['setUp', 'cleanup'], calls)
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
1116
2729.1.1 by Martin Pool
Add TestNotApplicable exception and handling of it; document test parameterization
1117
    def test_not_applicable(self):
1118
        # run a test that is skipped because it's not applicable
1119
        def not_applicable_test():
1120
            from bzrlib.tests import TestNotApplicable
1121
            raise TestNotApplicable('this test never runs')
1122
        out = StringIO()
1123
        runner = TextTestRunner(stream=out, verbosity=2)
1124
        test = unittest.FunctionTestCase(not_applicable_test)
1125
        result = self.run_test_runner(runner, test)
1126
        self._log_file.write(out.getvalue())
1127
        self.assertTrue(result.wasSuccessful())
1128
        self.assertTrue(result.wasStrictlySuccessful())
1129
        self.assertContainsRe(out.getvalue(),
1130
                r'(?m)not_applicable_test   * N/A')
1131
        self.assertContainsRe(out.getvalue(),
1132
                r'(?m)^    this test never runs')
1133
1134
    def test_not_applicable_demo(self):
1135
        # just so you can see it in the test output
1136
        raise TestNotApplicable('this test is just a demonstation')
1137
2367.1.5 by Robert Collins
Implement reporting of Unsupported tests in the bzr test result and runner
1138
    def test_unsupported_features_listed(self):
1139
        """When unsupported features are encountered they are detailed."""
1140
        class Feature1(Feature):
1141
            def _probe(self): return False
1142
        class Feature2(Feature):
1143
            def _probe(self): return False
1144
        # create sample tests
1145
        test1 = SampleTestCase('_test_pass')
1146
        test1._test_needs_features = [Feature1()]
1147
        test2 = SampleTestCase('_test_pass')
1148
        test2._test_needs_features = [Feature2()]
1149
        test = unittest.TestSuite()
1150
        test.addTest(test1)
1151
        test.addTest(test2)
1152
        stream = StringIO()
1153
        runner = TextTestRunner(stream=stream)
1154
        result = self.run_test_runner(runner, test)
1155
        lines = stream.getvalue().splitlines()
1156
        self.assertEqual([
1157
            'OK',
1158
            "Missing feature 'Feature1' skipped 1 tests.",
1159
            "Missing feature 'Feature2' skipped 1 tests.",
1160
            ],
2367.1.6 by Robert Collins
Allow per-test-fixture feature requirements via 'requireFeature'.(Robert Collins)
1161
            lines[-3:])
2367.1.5 by Robert Collins
Implement reporting of Unsupported tests in the bzr test result and runner
1162
1819.1.2 by Carl Friedrich Bolz
(lifeless, cfbolz, hpk): Add a benchmark output parameter to TextTestRunner.
1163
    def test_bench_history(self):
1951.1.1 by Andrew Bennetts
Make test_bench_history and _get_bzr_source_tree tolerant of UnknownFormatError for the bzr workingtree.
1164
        # tests that the running the benchmark produces a history file
1165
        # containing a timestamp and the revision id of the bzrlib source which
1166
        # was tested.
1167
        workingtree = _get_bzr_source_tree()
1819.1.2 by Carl Friedrich Bolz
(lifeless, cfbolz, hpk): Add a benchmark output parameter to TextTestRunner.
1168
        test = TestRunner('dummy_test')
1169
        output = StringIO()
1170
        runner = TextTestRunner(stream=self._log_file, bench_history=output)
1171
        result = self.run_test_runner(runner, test)
1172
        output_string = output.getvalue()
1951.1.1 by Andrew Bennetts
Make test_bench_history and _get_bzr_source_tree tolerant of UnknownFormatError for the bzr workingtree.
1173
        self.assertContainsRe(output_string, "--date [0-9.]+")
1174
        if workingtree is not None:
1908.7.6 by Robert Collins
Deprecate WorkingTree.last_revision.
1175
            revision_id = workingtree.get_parent_ids()[0]
1951.1.1 by Andrew Bennetts
Make test_bench_history and _get_bzr_source_tree tolerant of UnknownFormatError for the bzr workingtree.
1176
            self.assertEndsWith(output_string.rstrip(), revision_id)
1819.1.2 by Carl Friedrich Bolz
(lifeless, cfbolz, hpk): Add a benchmark output parameter to TextTestRunner.
1177
3199.1.1 by Vincent Ladeuil
Get rid of ~1000 useless log files out of 10.000 tests in /tmp.
1178
    def assertLogDeleted(self, test):
1179
        log = test._get_log()
1180
        self.assertEqual("DELETED log file to reduce memory footprint", log)
1181
        self.assertEqual('', test._log_contents)
1182
        self.assertIs(None, test._log_file_name)
1183
2036.1.1 by John Arbash Meinel
test that logs are kept or deleted when appropriate
1184
    def test_success_log_deleted(self):
1185
        """Successful tests have their log deleted"""
1186
1187
        class LogTester(TestCase):
1188
1189
            def test_success(self):
1190
                self.log('this will be removed\n')
1191
1192
        sio = cStringIO.StringIO()
1193
        runner = TextTestRunner(stream=sio)
1194
        test = LogTester('test_success')
1195
        result = self.run_test_runner(runner, test)
1196
3199.1.1 by Vincent Ladeuil
Get rid of ~1000 useless log files out of 10.000 tests in /tmp.
1197
        self.assertLogDeleted(test)
1198
1199
    def test_skipped_log_deleted(self):
1200
        """Skipped tests have their log deleted"""
1201
1202
        class LogTester(TestCase):
1203
1204
            def test_skipped(self):
1205
                self.log('this will be removed\n')
1206
                raise tests.TestSkipped()
1207
1208
        sio = cStringIO.StringIO()
1209
        runner = TextTestRunner(stream=sio)
1210
        test = LogTester('test_skipped')
1211
        result = self.run_test_runner(runner, test)
1212
1213
        self.assertLogDeleted(test)
1214
1215
    def test_not_aplicable_log_deleted(self):
1216
        """Not applicable tests have their log deleted"""
1217
1218
        class LogTester(TestCase):
1219
1220
            def test_not_applicable(self):
1221
                self.log('this will be removed\n')
1222
                raise tests.TestNotApplicable()
1223
1224
        sio = cStringIO.StringIO()
1225
        runner = TextTestRunner(stream=sio)
1226
        test = LogTester('test_not_applicable')
1227
        result = self.run_test_runner(runner, test)
1228
1229
        self.assertLogDeleted(test)
1230
1231
    def test_known_failure_log_deleted(self):
1232
        """Know failure tests have their log deleted"""
1233
1234
        class LogTester(TestCase):
1235
1236
            def test_known_failure(self):
1237
                self.log('this will be removed\n')
1238
                raise tests.KnownFailure()
1239
1240
        sio = cStringIO.StringIO()
1241
        runner = TextTestRunner(stream=sio)
1242
        test = LogTester('test_known_failure')
1243
        result = self.run_test_runner(runner, test)
1244
1245
        self.assertLogDeleted(test)
2036.1.1 by John Arbash Meinel
test that logs are kept or deleted when appropriate
1246
1247
    def test_fail_log_kept(self):
1248
        """Failed tests have their log kept"""
1249
1250
        class LogTester(TestCase):
1251
1252
            def test_fail(self):
1253
                self.log('this will be kept\n')
1254
                self.fail('this test fails')
1255
1256
        sio = cStringIO.StringIO()
1257
        runner = TextTestRunner(stream=sio)
1258
        test = LogTester('test_fail')
1259
        result = self.run_test_runner(runner, test)
1260
1261
        text = sio.getvalue()
1262
        self.assertContainsRe(text, 'this will be kept')
1263
        self.assertContainsRe(text, 'this test fails')
1264
1265
        log = test._get_log()
1266
        self.assertContainsRe(log, 'this will be kept')
1267
        self.assertEqual(log, test._log_contents)
1268
1269
    def test_error_log_kept(self):
1270
        """Tests with errors have their log kept"""
1271
1272
        class LogTester(TestCase):
1273
1274
            def test_error(self):
1275
                self.log('this will be kept\n')
1276
                raise ValueError('random exception raised')
1277
1278
        sio = cStringIO.StringIO()
1279
        runner = TextTestRunner(stream=sio)
1280
        test = LogTester('test_error')
1281
        result = self.run_test_runner(runner, test)
1282
1283
        text = sio.getvalue()
1284
        self.assertContainsRe(text, 'this will be kept')
1285
        self.assertContainsRe(text, 'random exception raised')
1286
1287
        log = test._get_log()
1288
        self.assertContainsRe(log, 'this will be kept')
1289
        self.assertEqual(log, test._log_contents)
1819.1.2 by Carl Friedrich Bolz
(lifeless, cfbolz, hpk): Add a benchmark output parameter to TextTestRunner.
1290
2036.1.2 by John Arbash Meinel
whitespace fix
1291
2367.1.3 by Robert Collins
Add support for calling addNotSupported on TestResults to bzr TestCase's
1292
class SampleTestCase(TestCase):
1293
1294
    def _test_pass(self):
1295
        pass
1296
1297
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
1298
class TestTestCase(TestCase):
1299
    """Tests that test the core bzrlib TestCase."""
1300
2560.1.1 by Robert Collins
Make debug.debug_flags be isolated for all tests.
1301
    def test_debug_flags_sanitised(self):
1302
        """The bzrlib debug flags should be sanitised by setUp."""
1303
        # we could set something and run a test that will check
1304
        # it gets santised, but this is probably sufficient for now:
1305
        # if someone runs the test with -Dsomething it will error.
1306
        self.assertEqual(set(), bzrlib.debug.debug_flags)
1307
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
1308
    def inner_test(self):
1309
        # the inner child test
1310
        note("inner_test")
1311
1312
    def outer_child(self):
1313
        # the outer child test
1314
        note("outer_start")
1315
        self.inner_test = TestTestCase("inner_child")
2095.4.1 by Martin Pool
Better progress bars during tests
1316
        result = bzrlib.tests.TextTestResult(self._log_file,
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
1317
                                        descriptions=0,
1318
                                        verbosity=1)
1319
        self.inner_test.run(result)
1320
        note("outer finish")
1321
1322
    def test_trace_nesting(self):
1323
        # this tests that each test case nests its trace facility correctly.
1324
        # we do this by running a test case manually. That test case (A)
1325
        # should setup a new log, log content to it, setup a child case (B),
1326
        # which should log independently, then case (A) should log a trailer
1327
        # and return.
1328
        # we do two nested children so that we can verify the state of the 
1329
        # logs after the outer child finishes is correct, which a bad clean
1330
        # up routine in tearDown might trigger a fault in our test with only
1331
        # one child, we should instead see the bad result inside our test with
1332
        # the two children.
1333
        # the outer child test
1334
        original_trace = bzrlib.trace._trace_file
1335
        outer_test = TestTestCase("outer_child")
2095.4.1 by Martin Pool
Better progress bars during tests
1336
        result = bzrlib.tests.TextTestResult(self._log_file,
1534.11.7 by Robert Collins
Test and correct the problem with nested test logs breaking further in-test logs.
1337
                                        descriptions=0,
1338
                                        verbosity=1)
1339
        outer_test.run(result)
1340
        self.assertEqual(original_trace, bzrlib.trace._trace_file)
1707.2.4 by Robert Collins
Teach the bzrlib TestCase to report the time take by calls to self.time as benchmark time, allowing granular reporting of time during benchmarks. See bzrlib.benchmarks.bench_add. (Robert Collins, Martin Pool)
1341
1342
    def method_that_times_a_bit_twice(self):
1343
        # call self.time twice to ensure it aggregates
1713.1.4 by Robert Collins
Make the test test_time_creates_benchmark_in_result more robust to timing variation.
1344
        self.time(time.sleep, 0.007)
1345
        self.time(time.sleep, 0.007)
1707.2.4 by Robert Collins
Teach the bzrlib TestCase to report the time take by calls to self.time as benchmark time, allowing granular reporting of time during benchmarks. See bzrlib.benchmarks.bench_add. (Robert Collins, Martin Pool)
1346
1347
    def test_time_creates_benchmark_in_result(self):
1348
        """Test that the TestCase.time() method accumulates a benchmark time."""
1349
        sample_test = TestTestCase("method_that_times_a_bit_twice")
1350
        output_stream = StringIO()
2095.4.1 by Martin Pool
Better progress bars during tests
1351
        result = bzrlib.tests.VerboseTestResult(
1707.2.4 by Robert Collins
Teach the bzrlib TestCase to report the time take by calls to self.time as benchmark time, allowing granular reporting of time during benchmarks. See bzrlib.benchmarks.bench_add. (Robert Collins, Martin Pool)
1352
            unittest._WritelnDecorator(output_stream),
1353
            descriptions=0,
2095.4.1 by Martin Pool
Better progress bars during tests
1354
            verbosity=2,
1355
            num_tests=sample_test.countTestCases())
1707.2.4 by Robert Collins
Teach the bzrlib TestCase to report the time take by calls to self.time as benchmark time, allowing granular reporting of time during benchmarks. See bzrlib.benchmarks.bench_add. (Robert Collins, Martin Pool)
1356
        sample_test.run(result)
1357
        self.assertContainsRe(
1358
            output_stream.getvalue(),
2067.3.1 by Martin Pool
Clean up BzrNewError, other exception classes and users.
1359
            r"\d+ms/ +\d+ms\n$")
2245.1.1 by Robert Collins
New Branch hooks facility, with one initial hook 'set_rh' which triggers
1360
1361
    def test_hooks_sanitised(self):
1362
        """The bzrlib hooks should be sanitised by setUp."""
2245.1.2 by Robert Collins
Remove the static DefaultHooks method from Branch, replacing it with a derived dict BranchHooks object, which is easier to use and provides a place to put the policy-checking add method discussed on list.
1363
        self.assertEqual(bzrlib.branch.BranchHooks(),
2245.1.1 by Robert Collins
New Branch hooks facility, with one initial hook 'set_rh' which triggers
1364
            bzrlib.branch.Branch.hooks)
2400.1.7 by Andrew Bennetts
Merge from bzr.dev.
1365
        self.assertEqual(bzrlib.smart.server.SmartServerHooks(),
1366
            bzrlib.smart.server.SmartTCPServer.hooks)
2245.1.1 by Robert Collins
New Branch hooks facility, with one initial hook 'set_rh' which triggers
1367
1725.1.1 by Robert Collins
'bzr selftest --benchmark --lsprof-timed' will use lsprofile to generate
1368
    def test__gather_lsprof_in_benchmarks(self):
1369
        """When _gather_lsprof_in_benchmarks is on, accumulate profile data.
1370
        
1371
        Each self.time() call is individually and separately profiled.
1372
        """
1551.15.28 by Aaron Bentley
Improve Feature usage style w/ lsprof
1373
        self.requireFeature(test_lsprof.LSProfFeature)
1725.1.1 by Robert Collins
'bzr selftest --benchmark --lsprof-timed' will use lsprofile to generate
1374
        # overrides the class member with an instance member so no cleanup 
1375
        # needed.
1376
        self._gather_lsprof_in_benchmarks = True
1377
        self.time(time.sleep, 0.000)
1378
        self.time(time.sleep, 0.003)
1379
        self.assertEqual(2, len(self._benchcalls))
1380
        self.assertEqual((time.sleep, (0.000,), {}), self._benchcalls[0][0])
1381
        self.assertEqual((time.sleep, (0.003,), {}), self._benchcalls[1][0])
1382
        self.assertIsInstance(self._benchcalls[0][1], bzrlib.lsprof.Stats)
1383
        self.assertIsInstance(self._benchcalls[1][1], bzrlib.lsprof.Stats)
1384
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
1385
    def test_knownFailure(self):
1386
        """Self.knownFailure() should raise a KnownFailure exception."""
1387
        self.assertRaises(KnownFailure, self.knownFailure, "A Failure")
1388
2367.1.6 by Robert Collins
Allow per-test-fixture feature requirements via 'requireFeature'.(Robert Collins)
1389
    def test_requireFeature_available(self):
1390
        """self.requireFeature(available) is a no-op."""
1391
        class Available(Feature):
1392
            def _probe(self):return True
1393
        feature = Available()
1394
        self.requireFeature(feature)
1395
1396
    def test_requireFeature_unavailable(self):
1397
        """self.requireFeature(unavailable) raises UnavailableFeature."""
1398
        class Unavailable(Feature):
1399
            def _probe(self):return False
1400
        feature = Unavailable()
1401
        self.assertRaises(UnavailableFeature, self.requireFeature, feature)
1402
2367.1.3 by Robert Collins
Add support for calling addNotSupported on TestResults to bzr TestCase's
1403
    def test_run_no_parameters(self):
1404
        test = SampleTestCase('_test_pass')
1405
        test.run()
1406
    
1407
    def test_run_enabled_unittest_result(self):
1408
        """Test we revert to regular behaviour when the test is enabled."""
1409
        test = SampleTestCase('_test_pass')
1410
        class EnabledFeature(object):
1411
            def available(self):
1412
                return True
1413
        test._test_needs_features = [EnabledFeature()]
1414
        result = unittest.TestResult()
1415
        test.run(result)
1416
        self.assertEqual(1, result.testsRun)
1417
        self.assertEqual([], result.errors)
1418
        self.assertEqual([], result.failures)
1419
1420
    def test_run_disabled_unittest_result(self):
1421
        """Test our compatability for disabled tests with unittest results."""
1422
        test = SampleTestCase('_test_pass')
1423
        class DisabledFeature(object):
1424
            def available(self):
1425
                return False
1426
        test._test_needs_features = [DisabledFeature()]
1427
        result = unittest.TestResult()
1428
        test.run(result)
1429
        self.assertEqual(1, result.testsRun)
1430
        self.assertEqual([], result.errors)
1431
        self.assertEqual([], result.failures)
1432
1433
    def test_run_disabled_supporting_result(self):
1434
        """Test disabled tests behaviour with support aware results."""
1435
        test = SampleTestCase('_test_pass')
1436
        class DisabledFeature(object):
1437
            def available(self):
1438
                return False
1439
        the_feature = DisabledFeature()
1440
        test._test_needs_features = [the_feature]
1441
        class InstrumentedTestResult(unittest.TestResult):
1442
            def __init__(self):
1443
                unittest.TestResult.__init__(self)
1444
                self.calls = []
1445
            def startTest(self, test):
1446
                self.calls.append(('startTest', test))
1447
            def stopTest(self, test):
1448
                self.calls.append(('stopTest', test))
1449
            def addNotSupported(self, test, feature):
1450
                self.calls.append(('addNotSupported', test, feature))
1451
        result = InstrumentedTestResult()
1452
        test.run(result)
1453
        self.assertEqual([
1454
            ('startTest', test),
1455
            ('addNotSupported', test, the_feature),
1456
            ('stopTest', test),
1457
            ],
1458
            result.calls)
1459
1534.11.4 by Robert Collins
Merge from mainline.
1460
1982.3.2 by Robert Collins
New TestCase helper applyDeprecated. This allows you to call a callable
1461
@symbol_versioning.deprecated_function(zero_eleven)
1462
def sample_deprecated_function():
1463
    """A deprecated function to test applyDeprecated with."""
1464
    return 2
1465
1466
1467
def sample_undeprecated_function(a_param):
1468
    """A undeprecated function to test applyDeprecated with."""
1469
1470
1471
class ApplyDeprecatedHelper(object):
1472
    """A helper class for ApplyDeprecated tests."""
1473
1474
    @symbol_versioning.deprecated_method(zero_eleven)
1475
    def sample_deprecated_method(self, param_one):
1476
        """A deprecated method for testing with."""
1477
        return param_one
1478
1479
    def sample_normal_method(self):
1480
        """A undeprecated method."""
1481
1482
    @symbol_versioning.deprecated_method(zero_ten)
1483
    def sample_nested_deprecation(self):
1484
        return sample_deprecated_function()
1485
1486
1540.3.22 by Martin Pool
[patch] Add TestCase.assertIsInstance
1487
class TestExtraAssertions(TestCase):
1488
    """Tests for new test assertions in bzrlib test suite"""
1489
1490
    def test_assert_isinstance(self):
1491
        self.assertIsInstance(2, int)
1492
        self.assertIsInstance(u'', basestring)
1493
        self.assertRaises(AssertionError, self.assertIsInstance, None, int)
1494
        self.assertRaises(AssertionError, self.assertIsInstance, 23.3, int)
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
1495
1692.3.1 by Robert Collins
Fix push to work with just a branch, no need for a working tree.
1496
    def test_assertEndsWith(self):
1497
        self.assertEndsWith('foo', 'oo')
1498
        self.assertRaises(AssertionError, self.assertEndsWith, 'o', 'oo')
1499
1982.3.2 by Robert Collins
New TestCase helper applyDeprecated. This allows you to call a callable
1500
    def test_applyDeprecated_not_deprecated(self):
1501
        sample_object = ApplyDeprecatedHelper()
1502
        # calling an undeprecated callable raises an assertion
1503
        self.assertRaises(AssertionError, self.applyDeprecated, zero_eleven,
1504
            sample_object.sample_normal_method)
1505
        self.assertRaises(AssertionError, self.applyDeprecated, zero_eleven,
1506
            sample_undeprecated_function, "a param value")
1507
        # calling a deprecated callable (function or method) with the wrong
1508
        # expected deprecation fails.
1509
        self.assertRaises(AssertionError, self.applyDeprecated, zero_ten,
1510
            sample_object.sample_deprecated_method, "a param value")
1511
        self.assertRaises(AssertionError, self.applyDeprecated, zero_ten,
1512
            sample_deprecated_function)
1513
        # calling a deprecated callable (function or method) with the right
1514
        # expected deprecation returns the functions result.
1515
        self.assertEqual("a param value", self.applyDeprecated(zero_eleven,
1516
            sample_object.sample_deprecated_method, "a param value"))
1517
        self.assertEqual(2, self.applyDeprecated(zero_eleven,
1518
            sample_deprecated_function))
1519
        # calling a nested deprecation with the wrong deprecation version
1520
        # fails even if a deeper nested function was deprecated with the 
1521
        # supplied version.
1522
        self.assertRaises(AssertionError, self.applyDeprecated,
1523
            zero_eleven, sample_object.sample_nested_deprecation)
1524
        # calling a nested deprecation with the right deprecation value
1525
        # returns the calls result.
1526
        self.assertEqual(2, self.applyDeprecated(zero_ten,
1527
            sample_object.sample_nested_deprecation))
1528
1551.8.9 by Aaron Bentley
Rename assertDeprecated to callDeprecated
1529
    def test_callDeprecated(self):
1551.8.8 by Aaron Bentley
Made assertDeprecated return the callable's result
1530
        def testfunc(be_deprecated, result=None):
1910.2.10 by Aaron Bentley
Add tests for assertDeprecated
1531
            if be_deprecated is True:
1532
                symbol_versioning.warn('i am deprecated', DeprecationWarning, 
1533
                                       stacklevel=1)
1551.8.8 by Aaron Bentley
Made assertDeprecated return the callable's result
1534
            return result
1551.8.9 by Aaron Bentley
Rename assertDeprecated to callDeprecated
1535
        result = self.callDeprecated(['i am deprecated'], testfunc, True)
1551.8.8 by Aaron Bentley
Made assertDeprecated return the callable's result
1536
        self.assertIs(None, result)
1551.8.9 by Aaron Bentley
Rename assertDeprecated to callDeprecated
1537
        result = self.callDeprecated([], testfunc, False, 'result')
1551.8.8 by Aaron Bentley
Made assertDeprecated return the callable's result
1538
        self.assertEqual('result', result)
1982.3.2 by Robert Collins
New TestCase helper applyDeprecated. This allows you to call a callable
1539
        self.callDeprecated(['i am deprecated'], testfunc, be_deprecated=True)
1551.8.9 by Aaron Bentley
Rename assertDeprecated to callDeprecated
1540
        self.callDeprecated([], testfunc, be_deprecated=False)
1910.2.10 by Aaron Bentley
Add tests for assertDeprecated
1541
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
1542
2592.3.242 by Martin Pool
New method TestCase.call_catch_warnings
1543
class TestWarningTests(TestCase):
1544
    """Tests for calling methods that raise warnings."""
1545
1546
    def test_callCatchWarnings(self):
1547
        def meth(a, b):
1548
            warnings.warn("this is your last warning")
1549
            return a + b
1550
        wlist, result = self.callCatchWarnings(meth, 1, 2)
1551
        self.assertEquals(3, result)
1552
        # would like just to compare them, but UserWarning doesn't implement
1553
        # eq well
1554
        w0, = wlist
1555
        self.assertIsInstance(w0, UserWarning)
2592.3.247 by Andrew Bennetts
Fix test_callCatchWarnings to pass when run with Python 2.4.
1556
        self.assertEquals("this is your last warning", str(w0))
2592.3.242 by Martin Pool
New method TestCase.call_catch_warnings
1557
1558
1666.1.4 by Robert Collins
* 'Metadir' is now the default disk format. This improves behaviour in
1559
class TestConvenienceMakers(TestCaseWithTransport):
1560
    """Test for the make_* convenience functions."""
1561
1562
    def test_make_branch_and_tree_with_format(self):
1563
        # we should be able to supply a format to make_branch_and_tree
1564
        self.make_branch_and_tree('a', format=bzrlib.bzrdir.BzrDirMetaFormat1())
1565
        self.make_branch_and_tree('b', format=bzrlib.bzrdir.BzrDirFormat6())
1566
        self.assertIsInstance(bzrlib.bzrdir.BzrDir.open('a')._format,
1567
                              bzrlib.bzrdir.BzrDirMetaFormat1)
1568
        self.assertIsInstance(bzrlib.bzrdir.BzrDir.open('b')._format,
1569
                              bzrlib.bzrdir.BzrDirFormat6)
1707.2.1 by Robert Collins
'bzr selftest --benchmark' will run a new benchmarking selftest.
1570
1986.2.1 by Robert Collins
Bugfix - the name of the test for make_branch_and_memory_tree was wrong.
1571
    def test_make_branch_and_memory_tree(self):
1986.1.2 by Robert Collins
Various changes to allow non-workingtree specific tests to run entirely
1572
        # we should be able to get a new branch and a mutable tree from
1573
        # TestCaseWithTransport
1574
        tree = self.make_branch_and_memory_tree('a')
1575
        self.assertIsInstance(tree, bzrlib.memorytree.MemoryTree)
1576
1707.2.1 by Robert Collins
'bzr selftest --benchmark' will run a new benchmarking selftest.
1577
1910.14.1 by Andrew Bennetts
Fix to make_branch_and_tree's behavior when used with an sftp transport.
1578
class TestSFTPMakeBranchAndTree(TestCaseWithSFTPServer):
1579
1580
    def test_make_tree_for_sftp_branch(self):
1581
        """Transports backed by local directories create local trees."""
1582
1583
        tree = self.make_branch_and_tree('t1')
1584
        base = tree.bzrdir.root_transport.base
1585
        self.failIf(base.startswith('sftp'),
1586
                'base %r is on sftp but should be local' % base)
1587
        self.assertEquals(tree.bzrdir.root_transport,
1588
                tree.branch.bzrdir.root_transport)
1589
        self.assertEquals(tree.bzrdir.root_transport,
1590
                tree.branch.repository.bzrdir.root_transport)
1591
1592
1707.2.1 by Robert Collins
'bzr selftest --benchmark' will run a new benchmarking selftest.
1593
class TestSelftest(TestCase):
1594
    """Tests of bzrlib.tests.selftest."""
1595
1596
    def test_selftest_benchmark_parameter_invokes_test_suite__benchmark__(self):
1597
        factory_called = []
1598
        def factory():
1599
            factory_called.append(True)
1600
            return TestSuite()
1601
        out = StringIO()
1602
        err = StringIO()
1603
        self.apply_redirected(out, err, None, bzrlib.tests.selftest, 
1604
            test_suite_factory=factory)
1605
        self.assertEqual([True], factory_called)
2172.4.3 by Alexander Belchenko
Change name of option to '--clean-output' and provide tests
1606
1607
2367.1.2 by Robert Collins
Some minor cleanups of test code, and implement KnownFailure support as
1608
class TestKnownFailure(TestCase):
1609
1610
    def test_known_failure(self):
1611
        """Check that KnownFailure is defined appropriately."""
1612
        # a KnownFailure is an assertion error for compatability with unaware
1613
        # runners.
1614
        self.assertIsInstance(KnownFailure(""), AssertionError)
2367.1.4 by Robert Collins
Add operating system Feature model to bzrlib.tests to allow writing tests
1615
1551.13.9 by Aaron Bentley
Implement TestCase.expectFailure
1616
    def test_expect_failure(self):
1617
        try:
1618
            self.expectFailure("Doomed to failure", self.assertTrue, False)
1619
        except KnownFailure, e:
1620
            self.assertEqual('Doomed to failure', e.args[0])
1621
        try:
1622
            self.expectFailure("Doomed to failure", self.assertTrue, True)
1623
        except AssertionError, e:
1624
            self.assertEqual('Unexpected success.  Should have failed:'
1625
                             ' Doomed to failure', e.args[0])
1626
        else:
1627
            self.fail('Assertion not raised')
1628
2367.1.4 by Robert Collins
Add operating system Feature model to bzrlib.tests to allow writing tests
1629
1630
class TestFeature(TestCase):
1631
1632
    def test_caching(self):
1633
        """Feature._probe is called by the feature at most once."""
1634
        class InstrumentedFeature(Feature):
1635
            def __init__(self):
1636
                Feature.__init__(self)
1637
                self.calls = []
1638
            def _probe(self):
1639
                self.calls.append('_probe')
1640
                return False
1641
        feature = InstrumentedFeature()
1642
        feature.available()
1643
        self.assertEqual(['_probe'], feature.calls)
1644
        feature.available()
1645
        self.assertEqual(['_probe'], feature.calls)
1646
1647
    def test_named_str(self):
1648
        """Feature.__str__ should thunk to feature_name()."""
1649
        class NamedFeature(Feature):
1650
            def feature_name(self):
1651
                return 'symlinks'
1652
        feature = NamedFeature()
1653
        self.assertEqual('symlinks', str(feature))
1654
1655
    def test_default_str(self):
1656
        """Feature.__str__ should default to __class__.__name__."""
1657
        class NamedFeature(Feature):
1658
            pass
1659
        feature = NamedFeature()
1660
        self.assertEqual('NamedFeature', str(feature))
2367.1.6 by Robert Collins
Allow per-test-fixture feature requirements via 'requireFeature'.(Robert Collins)
1661
1662
1663
class TestUnavailableFeature(TestCase):
1664
1665
    def test_access_feature(self):
1666
        feature = Feature()
1667
        exception = UnavailableFeature(feature)
1668
        self.assertIs(feature, exception.args[0])
2394.2.5 by Ian Clatworthy
list-only working, include test not
1669
1670
1671
class TestSelftestFiltering(TestCase):
1672
2394.2.7 by Ian Clatworthy
Added whitebox tests - filter_suite_by_re and sort_suite_by_re
1673
    def setUp(self):
1674
        self.suite = TestUtil.TestSuite()
1675
        self.loader = TestUtil.TestLoader()
1676
        self.suite.addTest(self.loader.loadTestsFromModuleNames([
1677
            'bzrlib.tests.test_selftest']))
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1678
        self.all_names = _test_ids(self.suite)
2394.2.7 by Ian Clatworthy
Added whitebox tests - filter_suite_by_re and sort_suite_by_re
1679
2921.6.9 by Robert Collins
* New helper function ``bzrlib.tests.condition_id_re`` which helps
1680
    def test_condition_id_re(self):
1681
        test_name = ('bzrlib.tests.test_selftest.TestSelftestFiltering.'
1682
            'test_condition_id_re')
1683
        filtered_suite = filter_suite_by_condition(self.suite,
1684
            condition_id_re('test_condition_id_re'))
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1685
        self.assertEqual([test_name], _test_ids(filtered_suite))
2921.6.9 by Robert Collins
* New helper function ``bzrlib.tests.condition_id_re`` which helps
1686
3193.1.2 by Vincent Ladeuil
Add condition_id_in_list and filter_suite_by_id_list capabilities.
1687
    def test_condition_id_in_list(self):
1688
        test_names = ['bzrlib.tests.test_selftest.TestSelftestFiltering.'
1689
                      'test_condition_id_in_list']
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1690
        id_list = tests.TestIdList(test_names)
3193.1.2 by Vincent Ladeuil
Add condition_id_in_list and filter_suite_by_id_list capabilities.
1691
        filtered_suite = filter_suite_by_condition(
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1692
            self.suite, tests.condition_id_in_list(id_list))
3193.1.2 by Vincent Ladeuil
Add condition_id_in_list and filter_suite_by_id_list capabilities.
1693
        my_pattern = 'TestSelftestFiltering.*test_condition_id_in_list'
1694
        re_filtered = filter_suite_by_re(self.suite, my_pattern)
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1695
        self.assertEqual(_test_ids(re_filtered), _test_ids(filtered_suite))
3193.1.2 by Vincent Ladeuil
Add condition_id_in_list and filter_suite_by_id_list capabilities.
1696
2921.6.8 by Robert Collins
* New helper function ``bzrlib.tests.condition_isinstance`` which helps
1697
    def test_condition_isinstance(self):
1698
        filtered_suite = filter_suite_by_condition(self.suite,
1699
            condition_isinstance(self.__class__))
1700
        class_pattern = 'bzrlib.tests.test_selftest.TestSelftestFiltering.'
1701
        re_filtered = filter_suite_by_re(self.suite, class_pattern)
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1702
        self.assertEqual(_test_ids(re_filtered), _test_ids(filtered_suite))
2921.6.8 by Robert Collins
* New helper function ``bzrlib.tests.condition_isinstance`` which helps
1703
2921.6.9 by Robert Collins
* New helper function ``bzrlib.tests.condition_id_re`` which helps
1704
    def test_exclude_tests_by_condition(self):
1705
        excluded_name = ('bzrlib.tests.test_selftest.TestSelftestFiltering.'
1706
            'test_exclude_tests_by_condition')
1707
        filtered_suite = exclude_tests_by_condition(self.suite,
1708
            lambda x:x.id() == excluded_name)
1709
        self.assertEqual(len(self.all_names) - 1,
1710
            filtered_suite.countTestCases())
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1711
        self.assertFalse(excluded_name in _test_ids(filtered_suite))
2921.6.9 by Robert Collins
* New helper function ``bzrlib.tests.condition_id_re`` which helps
1712
        remaining_names = list(self.all_names)
1713
        remaining_names.remove(excluded_name)
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1714
        self.assertEqual(remaining_names, _test_ids(filtered_suite))
2921.6.9 by Robert Collins
* New helper function ``bzrlib.tests.condition_id_re`` which helps
1715
2921.6.2 by Robert Collins
* New helper method ``bzrlib.tests.exclude_tests_by_re`` which gives a new
1716
    def test_exclude_tests_by_re(self):
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1717
        self.all_names = _test_ids(self.suite)
2921.6.2 by Robert Collins
* New helper method ``bzrlib.tests.exclude_tests_by_re`` which gives a new
1718
        filtered_suite = exclude_tests_by_re(self.suite, 'exclude_tests_by_re')
1719
        excluded_name = ('bzrlib.tests.test_selftest.TestSelftestFiltering.'
1720
            'test_exclude_tests_by_re')
1721
        self.assertEqual(len(self.all_names) - 1,
1722
            filtered_suite.countTestCases())
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1723
        self.assertFalse(excluded_name in _test_ids(filtered_suite))
2921.6.2 by Robert Collins
* New helper method ``bzrlib.tests.exclude_tests_by_re`` which gives a new
1724
        remaining_names = list(self.all_names)
1725
        remaining_names.remove(excluded_name)
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1726
        self.assertEqual(remaining_names, _test_ids(filtered_suite))
2921.6.2 by Robert Collins
* New helper method ``bzrlib.tests.exclude_tests_by_re`` which gives a new
1727
2921.6.7 by Robert Collins
* New helper function ``bzrlib.tests.filter_suite_by_condition`` which
1728
    def test_filter_suite_by_condition(self):
1729
        test_name = ('bzrlib.tests.test_selftest.TestSelftestFiltering.'
1730
            'test_filter_suite_by_condition')
1731
        filtered_suite = filter_suite_by_condition(self.suite,
1732
            lambda x:x.id() == test_name)
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1733
        self.assertEqual([test_name], _test_ids(filtered_suite))
2921.6.7 by Robert Collins
* New helper function ``bzrlib.tests.filter_suite_by_condition`` which
1734
2394.2.5 by Ian Clatworthy
list-only working, include test not
1735
    def test_filter_suite_by_re(self):
2921.6.7 by Robert Collins
* New helper function ``bzrlib.tests.filter_suite_by_condition`` which
1736
        filtered_suite = filter_suite_by_re(self.suite, 'test_filter_suite_by_r')
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1737
        filtered_names = _test_ids(filtered_suite)
2394.2.7 by Ian Clatworthy
Added whitebox tests - filter_suite_by_re and sort_suite_by_re
1738
        self.assertEqual(filtered_names, ['bzrlib.tests.test_selftest.'
1739
            'TestSelftestFiltering.test_filter_suite_by_re'])
2921.6.1 by Robert Collins
* New helper method ``bzrlib.tests.split_suite_by_re`` which splits a test
1740
3193.1.2 by Vincent Ladeuil
Add condition_id_in_list and filter_suite_by_id_list capabilities.
1741
    def test_filter_suite_by_id_list(self):
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1742
        test_list = ['bzrlib.tests.test_selftest.'
1743
                     'TestSelftestFiltering.test_filter_suite_by_id_list']
3193.1.2 by Vincent Ladeuil
Add condition_id_in_list and filter_suite_by_id_list capabilities.
1744
        filtered_suite = tests.filter_suite_by_id_list(
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1745
            self.suite, tests.TestIdList(test_list))
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1746
        filtered_names = _test_ids(filtered_suite)
3193.1.2 by Vincent Ladeuil
Add condition_id_in_list and filter_suite_by_id_list capabilities.
1747
        self.assertEqual(
1748
            filtered_names,
1749
            ['bzrlib.tests.test_selftest.'
1750
             'TestSelftestFiltering.test_filter_suite_by_id_list'])
1751
2921.6.6 by Robert Collins
* The ``exclude_pattern`` and ``random_order`` parameters to the function
1752
    def test_preserve_input(self):
1753
        # NB: Surely this is something in the stdlib to do this?
1754
        self.assertTrue(self.suite is preserve_input(self.suite))
1755
        self.assertTrue("@#$" is preserve_input("@#$"))
1756
3128.1.2 by Vincent Ladeuil
Tweak as per review feedback: s/randomise.*/randomize&/, 0.92 -> 1.0.
1757
    def test_randomize_suite(self):
1758
        randomized_suite = randomize_suite(self.suite)
1759
        # randomizing should not add or remove test names.
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1760
        self.assertEqual(set(_test_ids(self.suite)),
1761
                         set(_test_ids(randomized_suite)))
2921.6.3 by Robert Collins
* New helper method ``bzrlib.tests.randomise_suite`` which returns a
1762
        # Technically, this *can* fail, because random.shuffle(list) can be
1763
        # equal to list. Trying multiple times just pushes the frequency back.
1764
        # As its len(self.all_names)!:1, the failure frequency should be low
1765
        # enough to ignore. RBC 20071021.
1766
        # It should change the order.
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1767
        self.assertNotEqual(self.all_names, _test_ids(randomized_suite))
2921.6.3 by Robert Collins
* New helper method ``bzrlib.tests.randomise_suite`` which returns a
1768
        # But not the length. (Possibly redundant with the set test, but not
1769
        # necessarily.)
3302.7.4 by Vincent Ladeuil
Cosmetic change.
1770
        self.assertEqual(len(self.all_names), len(_test_ids(randomized_suite)))
2921.6.3 by Robert Collins
* New helper method ``bzrlib.tests.randomise_suite`` which returns a
1771
3350.5.1 by Robert Collins
* New helper function for splitting test suites ``split_suite_by_condition``.
1772
    def test_split_suit_by_condition(self):
1773
        self.all_names = _test_ids(self.suite)
1774
        condition = condition_id_re('test_filter_suite_by_r')
1775
        split_suite = split_suite_by_condition(self.suite, condition)
1776
        filtered_name = ('bzrlib.tests.test_selftest.TestSelftestFiltering.'
1777
            'test_filter_suite_by_re')
1778
        self.assertEqual([filtered_name], _test_ids(split_suite[0]))
1779
        self.assertFalse(filtered_name in _test_ids(split_suite[1]))
1780
        remaining_names = list(self.all_names)
1781
        remaining_names.remove(filtered_name)
1782
        self.assertEqual(remaining_names, _test_ids(split_suite[1]))
1783
2921.6.1 by Robert Collins
* New helper method ``bzrlib.tests.split_suite_by_re`` which splits a test
1784
    def test_split_suit_by_re(self):
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1785
        self.all_names = _test_ids(self.suite)
2921.6.7 by Robert Collins
* New helper function ``bzrlib.tests.filter_suite_by_condition`` which
1786
        split_suite = split_suite_by_re(self.suite, 'test_filter_suite_by_r')
2921.6.1 by Robert Collins
* New helper method ``bzrlib.tests.split_suite_by_re`` which splits a test
1787
        filtered_name = ('bzrlib.tests.test_selftest.TestSelftestFiltering.'
1788
            'test_filter_suite_by_re')
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1789
        self.assertEqual([filtered_name], _test_ids(split_suite[0]))
1790
        self.assertFalse(filtered_name in _test_ids(split_suite[1]))
2921.6.1 by Robert Collins
* New helper method ``bzrlib.tests.split_suite_by_re`` which splits a test
1791
        remaining_names = list(self.all_names)
1792
        remaining_names.remove(filtered_name)
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1793
        self.assertEqual(remaining_names, _test_ids(split_suite[1]))
2921.6.1 by Robert Collins
* New helper method ``bzrlib.tests.split_suite_by_re`` which splits a test
1794
2545.3.2 by James Westby
Add a test for check_inventory_shape.
1795
1796
class TestCheckInventoryShape(TestCaseWithTransport):
1797
1798
    def test_check_inventory_shape(self):
2561.1.2 by Aaron Bentley
Fix indenting in TestCheckInventoryShape
1799
        files = ['a', 'b/', 'b/c']
1800
        tree = self.make_branch_and_tree('.')
1801
        self.build_tree(files)
1802
        tree.add(files)
1803
        tree.lock_read()
1804
        try:
1805
            self.check_inventory_shape(tree.inventory, files)
1806
        finally:
1807
            tree.unlock()
2830.2.1 by Martin Pool
If TestCase.run_bzr hits an internal exception, don't catch it but rather propagate up into the test suite
1808
1809
1810
class TestBlackboxSupport(TestCase):
1811
    """Tests for testsuite blackbox features."""
1812
1813
    def test_run_bzr_failure_not_caught(self):
1814
        # When we run bzr in blackbox mode, we want any unexpected errors to
1815
        # propagate up to the test suite so that it can show the error in the
1816
        # usual way, and we won't get a double traceback.
1817
        e = self.assertRaises(
1818
            AssertionError,
1819
            self.run_bzr, ['assert-fail'])
1820
        # make sure we got the real thing, not an error from somewhere else in
1821
        # the test framework
1822
        self.assertEquals('always fails', str(e))
1823
        # check that there's no traceback in the test log
1824
        self.assertNotContainsRe(self._get_log(keep_log_file=True),
1825
            r'Traceback')
1826
1827
    def test_run_bzr_user_error_caught(self):
1828
        # Running bzr in blackbox mode, normal/expected/user errors should be
1829
        # caught in the regular way and turned into an error message plus exit
1830
        # code.
1831
        out, err = self.run_bzr(["log", "/nonexistantpath"], retcode=3)
1832
        self.assertEqual(out, '')
3146.4.7 by Aaron Bentley
Remove UNIX path assumption
1833
        self.assertContainsRe(err,
1834
            'bzr: ERROR: Not a branch: ".*nonexistantpath/".\n')
2921.6.13 by Robert Collins
* Modules can now customise their tests by defining a ``load_tests``
1835
1836
1837
class TestTestLoader(TestCase):
1838
    """Tests for the test loader."""
1839
1840
    def _get_loader_and_module(self):
1841
        """Gets a TestLoader and a module with one test in it."""
1842
        loader = TestUtil.TestLoader()
1843
        module = {}
1844
        class Stub(TestCase):
1845
            def test_foo(self):
1846
                pass
1847
        class MyModule(object):
1848
            pass
1849
        MyModule.a_class = Stub
1850
        module = MyModule()
1851
        return loader, module
1852
1853
    def test_module_no_load_tests_attribute_loads_classes(self):
1854
        loader, module = self._get_loader_and_module()
1855
        self.assertEqual(1, loader.loadTestsFromModule(module).countTestCases())
1856
1857
    def test_module_load_tests_attribute_gets_called(self):
1858
        loader, module = self._get_loader_and_module()
1859
        # 'self' is here because we're faking the module with a class. Regular
1860
        # load_tests do not need that :)
1861
        def load_tests(self, standard_tests, module, loader):
1862
            result = loader.suiteClass()
1863
            for test in iter_suite_tests(standard_tests):
1864
                result.addTests([test, test])
1865
            return result
1866
        # add a load_tests() method which multiplies the tests from the module.
1867
        module.__class__.load_tests = load_tests
1868
        self.assertEqual(2, loader.loadTestsFromModule(module).countTestCases())
1869
3302.7.3 by Vincent Ladeuil
Prepare TestLoader for specialization.
1870
    def test_load_tests_from_module_name_smoke_test(self):
1871
        loader = TestUtil.TestLoader()
1872
        suite = loader.loadTestsFromModuleName('bzrlib.tests.test_sampler')
1873
        self.assertEquals(['bzrlib.tests.test_sampler.DemoTest.test_nothing'],
1874
                          _test_ids(suite))
1875
3302.7.8 by Vincent Ladeuil
Fix typos.
1876
    def test_load_tests_from_module_name_with_bogus_module_name(self):
3302.7.3 by Vincent Ladeuil
Prepare TestLoader for specialization.
1877
        loader = TestUtil.TestLoader()
1878
        self.assertRaises(ImportError, loader.loadTestsFromModuleName, 'bogus')
1879
3193.1.1 by Vincent Ladeuil
Helper to filter test suite building by module when loading a list.
1880
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1881
class TestTestIdList(tests.TestCase):
1882
1883
    def _create_id_list(self, test_list):
1884
        return tests.TestIdList(test_list)
1885
1886
    def _create_suite(self, test_id_list):
3193.1.5 by Vincent Ladeuil
Add helper method to get only listed tests from a module test suite.
1887
1888
        class Stub(TestCase):
1889
            def test_foo(self):
1890
                pass
1891
1892
        def _create_test_id(id):
1893
            return lambda: id
1894
1895
        suite = TestUtil.TestSuite()
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1896
        for id in test_id_list:
3193.1.5 by Vincent Ladeuil
Add helper method to get only listed tests from a module test suite.
1897
            t  = Stub('test_foo')
1898
            t.id = _create_test_id(id)
1899
            suite.addTest(t)
1900
        return suite
1901
1902
    def _test_ids(self, test_suite):
1903
        """Get the ids for the tests in a test suite."""
1904
        return [t.id() for t in iter_suite_tests(test_suite)]
1905
3193.1.1 by Vincent Ladeuil
Helper to filter test suite building by module when loading a list.
1906
    def test_empty_list(self):
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1907
        id_list = self._create_id_list([])
1908
        self.assertEquals({}, id_list.tests)
1909
        self.assertEquals({}, id_list.modules)
3193.1.1 by Vincent Ladeuil
Helper to filter test suite building by module when loading a list.
1910
1911
    def test_valid_list(self):
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1912
        id_list = self._create_id_list(
3193.1.4 by Vincent Ladeuil
Make TestTestIdListFilter aware that a test exists for a module or one of
1913
            ['mod1.cl1.meth1', 'mod1.cl1.meth2',
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1914
             'mod1.func1', 'mod1.cl2.meth2',
1915
             'mod1.submod1',
3193.1.4 by Vincent Ladeuil
Make TestTestIdListFilter aware that a test exists for a module or one of
1916
             'mod1.submod2.cl1.meth1', 'mod1.submod2.cl2.meth2',
1917
             ])
3302.8.3 by Vincent Ladeuil
Use better names for TestIdList methods.
1918
        self.assertTrue(id_list.refers_to('mod1'))
1919
        self.assertTrue(id_list.refers_to('mod1.submod1'))
1920
        self.assertTrue(id_list.refers_to('mod1.submod2'))
1921
        self.assertTrue(id_list.includes('mod1.cl1.meth1'))
1922
        self.assertTrue(id_list.includes('mod1.submod1'))
1923
        self.assertTrue(id_list.includes('mod1.func1'))
3193.1.1 by Vincent Ladeuil
Helper to filter test suite building by module when loading a list.
1924
1925
    def test_bad_chars_in_params(self):
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1926
        id_list = self._create_id_list(['mod1.cl1.meth1(xx.yy)'])
3302.8.3 by Vincent Ladeuil
Use better names for TestIdList methods.
1927
        self.assertTrue(id_list.refers_to('mod1'))
1928
        self.assertTrue(id_list.includes('mod1.cl1.meth1(xx.yy)'))
3193.1.4 by Vincent Ladeuil
Make TestTestIdListFilter aware that a test exists for a module or one of
1929
1930
    def test_module_used(self):
3193.1.11 by Vincent Ladeuil
Relax constraint on test ids, simplify implementation and update tests.
1931
        id_list = self._create_id_list(['mod.class.meth'])
3302.8.3 by Vincent Ladeuil
Use better names for TestIdList methods.
1932
        self.assertTrue(id_list.refers_to('mod'))
1933
        self.assertTrue(id_list.refers_to('mod.class'))
1934
        self.assertTrue(id_list.refers_to('mod.class.meth'))
3193.1.6 by Vincent Ladeuil
Filter the whole test suite.
1935
1936
    def test_test_suite(self):
1937
        # This test is slow, so we do a single test with one test in each
1938
        # category
1939
        test_list = [
1940
            # testmod_names
3302.9.23 by Vincent Ladeuil
Simplify test_suite().
1941
            'bzrlib.tests.blackbox.test_branch.TestBranch.test_branch',
3193.1.12 by Vincent Ladeuil
Fix typo (using test id list is no replacement for running the whole test suite QED).
1942
            'bzrlib.tests.test_selftest.TestTestIdList.test_test_suite',
3193.1.6 by Vincent Ladeuil
Filter the whole test suite.
1943
            # transport implementations
1944
            'bzrlib.tests.test_transport_implementations.TransportTests'
1945
            '.test_abspath(LocalURLServer)',
3302.9.23 by Vincent Ladeuil
Simplify test_suite().
1946
            # modules_to_doctest
3193.1.6 by Vincent Ladeuil
Filter the whole test suite.
1947
            'bzrlib.timestamp.format_highres_date',
3193.1.8 by Vincent Ladeuil
Add '--load-list' option to selftest.
1948
            # plugins can't be tested that way since selftest may be run with
1949
            # --no-plugins
3193.1.6 by Vincent Ladeuil
Filter the whole test suite.
1950
            ]
1951
        suite = tests.test_suite(test_list)
3302.7.1 by Vincent Ladeuil
Extract _test_ids helper for reuse by other test classes.
1952
        self.assertEquals(test_list, _test_ids(suite))
3193.1.7 by Vincent Ladeuil
Load test id list from a text file.
1953
3302.3.1 by Vincent Ladeuil
Help identify duplicates IDs in test suite and missing tests in id
1954
    def test_test_suite_matches_id_list_with_unknown(self):
1955
        loader = TestUtil.TestLoader()
3302.7.6 by Vincent Ladeuil
Catch up with loadTestsFromModuleName use.
1956
        suite = loader.loadTestsFromModuleName('bzrlib.tests.test_sampler')
3302.3.1 by Vincent Ladeuil
Help identify duplicates IDs in test suite and missing tests in id
1957
        test_list = ['bzrlib.tests.test_sampler.DemoTest.test_nothing',
1958
                     'bogus']
1959
        not_found, duplicates = tests.suite_matches_id_list(suite, test_list)
1960
        self.assertEquals(['bogus'], not_found)
1961
        self.assertEquals([], duplicates)
1962
1963
    def test_suite_matches_id_list_with_duplicates(self):
1964
        loader = TestUtil.TestLoader()
3302.7.6 by Vincent Ladeuil
Catch up with loadTestsFromModuleName use.
1965
        suite = loader.loadTestsFromModuleName('bzrlib.tests.test_sampler')
3302.3.1 by Vincent Ladeuil
Help identify duplicates IDs in test suite and missing tests in id
1966
        dupes = loader.suiteClass()
1967
        for test in iter_suite_tests(suite):
1968
            dupes.addTest(test)
1969
            dupes.addTest(test) # Add it again
1970
1971
        test_list = ['bzrlib.tests.test_sampler.DemoTest.test_nothing',]
1972
        not_found, duplicates = tests.suite_matches_id_list(
1973
            dupes, test_list)
1974
        self.assertEquals([], not_found)
1975
        self.assertEquals(['bzrlib.tests.test_sampler.DemoTest.test_nothing'],
1976
                          duplicates)
1977
3193.1.7 by Vincent Ladeuil
Load test id list from a text file.
1978
1979
class TestLoadTestIdList(tests.TestCaseInTempDir):
1980
1981
    def _create_test_list_file(self, file_name, content):
1982
        fl = open(file_name, 'wt')
1983
        fl.write(content)
1984
        fl.close()
1985
1986
    def test_load_unknown(self):
1987
        self.assertRaises(errors.NoSuchFile,
1988
                          tests.load_test_id_list, 'i_do_not_exist')
1989
1990
    def test_load_test_list(self):
1991
        test_list_fname = 'test.list'
1992
        self._create_test_list_file(test_list_fname,
1993
                                    'mod1.cl1.meth1\nmod2.cl2.meth2\n')
1994
        tlist = tests.load_test_id_list(test_list_fname)
1995
        self.assertEquals(2, len(tlist))
1996
        self.assertEquals('mod1.cl1.meth1', tlist[0])
1997
        self.assertEquals('mod2.cl2.meth2', tlist[1])
1998
1999
    def test_load_dirty_file(self):
2000
        test_list_fname = 'test.list'
2001
        self._create_test_list_file(test_list_fname,
2002
                                    '  mod1.cl1.meth1\n\nmod2.cl2.meth2  \n'
2003
                                    'bar baz\n')
2004
        tlist = tests.load_test_id_list(test_list_fname)
2005
        self.assertEquals(4, len(tlist))
2006
        self.assertEquals('mod1.cl1.meth1', tlist[0])
2007
        self.assertEquals('', tlist[1])
2008
        self.assertEquals('mod2.cl2.meth2', tlist[2])
2009
        self.assertEquals('bar baz', tlist[3])
2010
2011
3302.8.2 by Vincent Ladeuil
New test loader reducing modules imports and tests loaded.
2012
class TestFilteredByModuleTestLoader(tests.TestCase):
2013
2014
    def _create_loader(self, test_list):
2015
        id_filter = tests.TestIdList(test_list)
3302.8.4 by Vincent Ladeuil
Cosmetic changes.
2016
        loader = TestUtil.FilteredByModuleTestLoader(id_filter.refers_to)
3302.8.2 by Vincent Ladeuil
New test loader reducing modules imports and tests loaded.
2017
        return loader
2018
2019
    def test_load_tests(self):
2020
        test_list = ['bzrlib.tests.test_sampler.DemoTest.test_nothing']
2021
        loader = self._create_loader(test_list)
2022
2023
        suite = loader.loadTestsFromModuleName('bzrlib.tests.test_sampler')
2024
        self.assertEquals(test_list, _test_ids(suite))
2025
2026
    def test_exclude_tests(self):
2027
        test_list = ['bogus']
2028
        loader = self._create_loader(test_list)
2029
2030
        suite = loader.loadTestsFromModuleName('bzrlib.tests.test_sampler')
2031
        self.assertEquals([], _test_ids(suite))