annotate test/runtests.jl @ 760:e7176fb09e98 test/type_stability

Add utility function for testing type stability using the @inferred macro to allow for tests failing, rather than producing an error.
author Vidar Stiernström <vidar.stiernstrom@it.uu.se>
date Fri, 02 Jul 2021 14:02:45 +0200
parents e279c53eb647
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
333
01b851161018 Start converting to one package by moving all the files to their correct location
Jonatan Werpers <jonatan@werpers.com>
parents:
diff changeset
1 using Test
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
2 using Glob
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
3
760
e7176fb09e98 Add utility function for testing type stability using the @inferred macro to allow for tests failing, rather than producing an error.
Vidar Stiernström <vidar.stiernstrom@it.uu.se>
parents: 733
diff changeset
4 include("test_util.jl")
e7176fb09e98 Add utility function for testing type stability using the @inferred macro to allow for tests failing, rather than producing an error.
Vidar Stiernström <vidar.stiernstrom@it.uu.se>
parents: 733
diff changeset
5
e7176fb09e98 Add utility function for testing type stability using the @inferred macro to allow for tests failing, rather than producing an error.
Vidar Stiernström <vidar.stiernstrom@it.uu.se>
parents: 733
diff changeset
6
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
7 """
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
8 run_testfiles()
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
9 run_testfiles(path, globs)
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
10
711
df88aee35bb9 Switch to _test.jl suffix
Jonatan Werpers <jonatan@werpers.com>
parents: 709
diff changeset
11 Find and run all files with filenames ending with "_test.jl". If `path` is omitted the test folder is assumed.
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
12 The argument `globs` can optionally be supplied to filter which test files are run.
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
13 """
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
14 function run_testfiles(args)
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
15 if isempty(args)
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
16 globs = [fn"./*"]
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
17 else
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
18 globs = Glob.FilenameMatch.("./".*args)
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
19 end
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
20
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
21 run_testfiles(".", globs)
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
22 end
333
01b851161018 Start converting to one package by moving all the files to their correct location
Jonatan Werpers <jonatan@werpers.com>
parents:
diff changeset
23
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
24 function run_testfiles(path, globs)
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
25 for name ∈ readdir(path)
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
26 filepath = joinpath(path, name)
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
27
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
28 if isdir(filepath)
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
29 @testset "$name" begin
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
30 run_testfiles(filepath, globs)
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
31 end
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
32 end
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
33
717
1c5600a711ae Allow multiple filters
Jonatan Werpers <jonatan@werpers.com>
parents: 713
diff changeset
34 if endswith(name, "_test.jl") && any(occursin.(globs, filepath))
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
35 printstyled("Running "; bold=true, color=:green)
729
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
36 print(filepath)
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
37
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
38 t_start = time()
713
be648c6d6686 Wrap each file in a testset
Jonatan Werpers <jonatan@werpers.com>
parents: 711
diff changeset
39 @testset "$name" begin
be648c6d6686 Wrap each file in a testset
Jonatan Werpers <jonatan@werpers.com>
parents: 711
diff changeset
40 include(filepath)
be648c6d6686 Wrap each file in a testset
Jonatan Werpers <jonatan@werpers.com>
parents: 711
diff changeset
41 end
729
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
42 t_end = time()
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
43
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
44 Δt = t_end - t_start
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
45 printstyled(" ($(round(Δt, digits=2)) s)"; color=:light_black)
1ea81e106482 Add timing for each file
Jonatan Werpers <jonatan@werpers.com>
parents: 727
diff changeset
46 println()
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
47 end
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
48 end
333
01b851161018 Start converting to one package by moving all the files to their correct location
Jonatan Werpers <jonatan@werpers.com>
parents:
diff changeset
49 end
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
50
730
840557a58ac0 Change formatting for the global test set name when usign globs
Jonatan Werpers <jonatan@werpers.com>
parents: 729
diff changeset
51 testsetname = isempty(ARGS) ? "Sbplib.jl" : "["*join(ARGS, ", ")*"]"
709
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
52
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
53 @testset "$testsetname" begin
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
54 run_testfiles(ARGS)
48a61e085e60 Add function for selecting tests
Jonatan Werpers <jonatan@werpers.com>
parents: 445
diff changeset
55 end