Script to find order-dependent test failures

This script runs all (ordered) pairs of tests, and reports which pairs
result in a test failure.

1 files changed, 23 insertions, 0 deletions

diff --git a/script/spec-all-pairs b/script/spec-all-pairs
new file mode 100755
index 000000000..14e1803ba
--- /dev/null
+++ b/script/spec-all-pairs
@@ -0,0 +1,23 @@
+#!/bin/bash
+
+# Try all ordered pairs of spec files,
+# to winkle out order-dependent failures.
+
+specs=spec/*/*.rb
+
+for spec1 in $specs
+do
+    seen=false
+    for spec2 in $specs
+    do
+        if [ "$spec1" != "$spec2" ]
+        then
+            rake db:test:purge
+            rake db:test:clone_structure
+            if ! ( script/spec "$spec1" "$spec2" ) > /dev/null
+            then
+                echo "FAILED: $spec1 $spec2"
+            fi
+        fi
+    done
+done