Commit Graph

869 Commits

Author SHA1 Message Date
Måns Rullgård
77cce79aa7 fate: ensure all imported rules are handled by helpers
Originally committed as revision 24318 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:50:03 +00:00
Måns Rullgård
cdaf4b79bb fate: simplify test runner slightly
All tests use the provided helper functions so prepending $target_exec
and using eval is no longer required.

Originally committed as revision 24317 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:46:44 +00:00
Måns Rullgård
f366a6de31 fate: use helper functions in test rules
Originally committed as revision 24316 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:46:42 +00:00
Måns Rullgård
2b18c451bd fate: add some helper functions to simplify test rules
Originally committed as revision 24314 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:30 +00:00
Måns Rullgård
f0388cf716 fate: apply TARGET_EXEC only to commands starting with absolute path
Originally committed as revision 24313 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:25 +00:00
Måns Rullgård
d2f33c8021 fate: use our variable names in test rules imported from Mike's db
Originally committed as revision 24312 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:21 +00:00
Måns Rullgård
122a9af76b fate-run: rename some variables consistently with other files
Originally committed as revision 24311 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:16 +00:00
Måns Rullgård
ed62c6b624 fate: do not delete ref files when updating tests from db
Originally committed as revision 24310 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:12 +00:00
Måns Rullgård
e153cfa867 fate: add stddev comparator
This allows CMP=stddev in test rules.  The test passes if the reported
stddev is <= the FUZZ value (default 1).

Originally committed as revision 24289 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-17 15:02:34 +00:00
Måns Rullgård
26e87a2261 fate: whitespace cosmetics
Originally committed as revision 24288 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-17 15:02:32 +00:00
Vitor Sessak
7c06faf894 Undo my revert at r24260.
This is the only way by now to test this codec.

Originally committed as revision 24286 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-17 10:50:25 +00:00
Måns Rullgård
6441d39d58 fate: update vc1 reference
Originally committed as revision 24263 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 12:37:09 +00:00
Vitor Sessak
1c435a0d4e Vorbis regtests
Originally committed as revision 24262 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 12:32:14 +00:00
Vitor Sessak
605014ca33 Revert r24258:
Log:
Add msmpeg4v1 regtest

Added:
   trunk/tests/ref/fate/msmpeg4v1
Modified:
   trunk/tests/fate2.mak

According to Mans, "make test" tests already msmpeg4v1.

Originally committed as revision 24260 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 10:19:21 +00:00
Vitor Sessak
58c9c95c75 Add msmpeg4v1 regtest
Originally committed as revision 24258 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 10:06:33 +00:00
Vitor Sessak
abc152d78e Add MS-GSM regtest
Originally committed as revision 24257 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 09:58:17 +00:00
Vitor Sessak
41511ae6cf ATRAC3 regtests
Originally committed as revision 24256 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 09:41:53 +00:00
Vitor Sessak
6944215a2f Add ATRAC1 regtest
Originally committed as revision 24255 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 09:35:26 +00:00
Vitor Sessak
044dadeff3 Add EAC3 regtests
Originally committed as revision 24254 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 09:24:09 +00:00
Vitor Sessak
cf39355978 Add AC3 regtests
Originally committed as revision 24253 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-16 09:09:53 +00:00
Vitor Sessak
0dc5ca2e12 Add TrueSpeech regtest
Originally committed as revision 24221 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-12 21:02:52 +00:00
Måns Rullgård
5ee08c8531 fate: add vp8 bilinear tests
Mike added these some time ago, and I forgot to update here.

Originally committed as revision 24220 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-12 20:24:23 +00:00
Vitor Sessak
e9e40c875e NellyMoser regtest
Originally committed as revision 24195 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-11 14:13:23 +00:00
Vitor Sessak
d4d5b66140 DTS Coherent Acoustics regtest
Originally committed as revision 24194 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-11 14:05:38 +00:00
Vitor Sessak
bb1e597736 Add Pictor/PC Paint PIC regtest
Originally committed as revision 24193 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-11 12:44:32 +00:00
Vitor Sessak
e798dbdd34 Psygnosis YOP demuxer and decoder test
Originally committed as revision 24181 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-11 00:07:31 +00:00
Vitor Sessak
e747ff1c63 Add Intel Music Coder regtest
Originally committed as revision 24180 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 23:50:17 +00:00
Vitor Sessak
369b49630d Add QDM2 test
Originally committed as revision 24178 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 23:41:26 +00:00
Vitor Sessak
827396688c Add QCELP regtest
Originally committed as revision 24176 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 23:15:45 +00:00
Vitor Sessak
1d9a8c347a Add MPEG2 field encoding fate2 regtest
Originally committed as revision 24175 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 22:57:19 +00:00
Vitor Sessak
6b7917ba3b Add RealAudio COOK fate2 test
Originally committed as revision 24168 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 18:46:10 +00:00
Vitor Sessak
65c58b168b Add fate2 test for RA288
Originally committed as revision 24167 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 18:43:01 +00:00
Måns Rullgård
06970a4ca3 fate: some AAC tests need FUZZ=2 on ARM
Originally committed as revision 24166 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 18:01:16 +00:00
Måns Rullgård
83b203dc94 fate: ensure file sizes match in oneoff tests
Originally committed as revision 24164 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 16:58:00 +00:00
Alex Converse
6a59b98445 AAC fate2 tests.
Originally committed as revision 24163 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 16:51:04 +00:00
Måns Rullgård
150ef830f5 fate: fail with a sensible error message if reference file is missing
Originally committed as revision 24152 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:55:16 +00:00
Måns Rullgård
7d610af6f2 fate: delete output files from successful tests
Originally committed as revision 24150 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:36:04 +00:00
Måns Rullgård
3ec8d24ac9 tiny_psnr: change error exit code from -1 to 1
Originally committed as revision 24149 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:26:39 +00:00
Måns Rullgård
cd3cb048d9 tiny_psnr: check fread() return values
Originally committed as revision 24148 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:26:36 +00:00
Måns Rullgård
58d2b15447 fate: exit with error immediately if test command fails
Originally committed as revision 24147 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:26:33 +00:00
Måns Rullgård
f6dddd3374 tiny_psnr: use abs()
Originally committed as revision 24146 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 19:27:07 +00:00
Vitor Sessak
5f0278f51c SIPR tests for "make fate2"
Originally committed as revision 24145 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 17:19:18 +00:00
Måns Rullgård
c43d77c163 tiny_psnr: skip wav headers on input files
The byte count printed excludes the header, and offsets are applied
after the the headers are skipped.

Reference files updated to reflect new output.  Some stddev/psnr values
have changed slightly due to headers no longer being compared.

Originally committed as revision 24143 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 16:06:05 +00:00
Måns Rullgård
7e264ca136 fate: add oneoff test for twinvq
Originally committed as revision 24135 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 00:40:55 +00:00
Måns Rullgård
aab3ea5f7d fate: add oneoff comparison method
This adds the 'oneoff' comparison method.  It compares two s16le pcm
files with a max difference <= the fuzz factor treated as success.
Default fuzz is 1.  On failure, the full tiny_psnr output is printed.

Originally committed as revision 24134 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 00:40:51 +00:00
Måns Rullgård
3ade7d32c1 fate: pass additional variables to test script
This passes the following additional variables to the test script:

- CMP  method to use comparing output with reference, default 'diff'
- REF  reference file, default 'tests/ref/fate/${test}'
- FUZZ maximum fuzz factor in comparison, meaning depends on CMP

Originally committed as revision 24133 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 00:40:45 +00:00
Vitor Sessak
cb0067ec25 tiny_psnr: print max absolute difference between files
Regression test reference updates are due to the extra output
from tiny_psnr.

Patch by Vitor Sessak

Originally committed as revision 24132 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 00:40:37 +00:00
Måns Rullgård
f955d45226 Change names of regtest output files to closer match the reference files
Originally committed as revision 24127 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-08 22:10:14 +00:00
Måns Rullgård
a9ef1aef79 regtest: put rgb and yuv reference files in correct place
Originally committed as revision 24118 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-08 18:44:00 +00:00
Måns Rullgård
42cb38632e regtest: put rgb and yuv reference files in correct place
SVN design flaw requires deleting dirs in separate step

Originally committed as revision 24117 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-08 18:43:56 +00:00