LDAS Test Results

Test Name Status Date System Version Tester gcc 4.1.1
Data Socket PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  
Compared to 1.7.0 (07/27/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 31.752222 16.461761 92.88% Faster Overall Wall Time (s) 0.063139 0.188255 198.16% Faster Overall CPU Time (s) 0.031254 0.114284 265.67% Faster

Compared to 1.8.0 (11/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 31.752222 17.283886 83.71% Faster Overall Wall Time (s) 0.063139 0.168998 167.66% Faster Overall CPU Time (s) 0.031254 0.105771 238.43% Faster

Compared to 1.9.0 (07/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 31.752222 17.557928 80.84% Faster Overall Wall Time (s) 0.063139 0.162579 157.50% Faster Overall CPU Time (s) 0.031254 0.102934 229.35% Faster

Database Insertion PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  dbperformance.tcl passed with ilwdtypes table but still fails to do stats with 1.7.0
Compared to 1.9.0 (2007.07.18)
New AvgOld AvgAnalysis
Overall Rate (MB/s)3770.8177345011.199049 75.25% Slower
Overall Wall Time (s)0.0510590.06743375.72% Faster
Compared to 1.8.0 (2005.10.31)
New AvgOld AvgAnalysis
Overall Rate (MB/s)3770.8177345281.696207 71.39% Slower
Overall Wall Time (s)0.0510590.049207103.76% Slower
Compared to 1.7.0 (2005.07.27)
New AvgOld AvgAnalysis
Overall Rate (MB/s)3770.8177347206.827671 52.32% Slower
Overall Wall Time (s)0.0510590.039537129.14% Slower
Database Exception / Misc PASS 06/27/2008 ldas-dev
(gateway/metaserver)
1.9.346 Mary Lei  
descMetaData PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  
DMT loop PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  metadata got stuck and did not processing jobs until after reboot
Frame Accessors PASS ? 06/27/2008 ldas-dev 1.9.346 Mary Lei 11 failed. See PR821 for a current list of unsupported accessors.
Frame Gaps PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  version 4 frames needs to be skipped. Skipped tests involving wrapper: frgap-16.tcl:49/245 frgap-18:47/235 frgap-48.tcl:33/165 frgap-80:33/165
Frame dt Check PASS ? 06/27/2008 ldas-dev 1.9.346 Mary Lei  16 failed: getFrameElements channel_not_found
Frame Multi-Type/Size PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  
db* Matrix PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei wrapper tests and those requiring version 4 frames are all skipped. They were found to leak up to 100KB/Job in datacondAPI before.
Wrapper State SKIP 06/27/2008 ldas-dev 1.9.346 Mary Lei  Skipped due to non-functional wrapper in centos build
data/putStandAlone Loops PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  metadata get stuck in futex and did not processed jobs until after manual reboot.
Memory Check PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  
data/putStandAlone FAIL 01/04/2008 ldas-dev (beowulf) 1.9.164 Mary Lei Script hangs with first job using standalone wrapper. burstwrapper dso not included. Sometimes see a difference in inspiral job between standalone and pipeline: effective_distance had a value of 0.0 in summ_value table when it should be 1.8066820
Small round-off differeneces in burst DSOs (slope, tfclusters).
putStandAlone Exception PASS 06/27/2008 ldas-dev
(gateway/metaserver)
1.9.346 Mary Lei Skipped wrapper jobs. The script is repeated 3 times without any ill effects.
Compression PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  
DC to Frame FAIL 06/27/2008 ldas-dev 1.9.346 Mary Lei  FrCheck flags no checksum.
Datacond MDC PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei All 419 tests passed but no emails were received as email is being turned off on dev. Need to close mail client before running test. Expected: Total emails 419, 137 expected to pass, 282 expected to fail, got 0 unexpected results.
FrProc Read/Write PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  
createRDS PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei "Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - merged PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei "Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - level 2 PASS 06/27/2008 ldas-dev 1.9.346 Mary Lei  
RDS verification FAIL 06/27/2008 ldas-dev 1.9.346 Mary Lei MultiFrame E11Pre1 Level1 passed but Level 2 failed and had to be terminated manually. RDS Verification test verifies level 1, 2, multiframe, concat frame and multiconcat frames.
RDS in dataPipeline FAIL 06/30/2008 ldas-dev 1.9.346 Mary Lei  Early timeout in LDASJobH causes excessive jobs reporting frame file already exist and orphaned threads.
Level 2 RDS in dataPipeline FAIL 06/30/2008 ldas-dev 1.9.346 Mary Lei  Early timeout in LDASJobH causes excessive jobs reporting frame file already exist and orphaned threads.
Merged RDS in dataPipeline SKIP 06/30/2008 ldas-dev 1.9.346 Mary Lei  Early timeout in LDASJobH causes excessive jobs reporting frame file already exist and orphaned threads.
NDAS in dataPipeline SKIP 06/27/2008 ldas-dev 1.9.346 Mary Lei All skipped. New largest difference with gcc 4.1.1 is 2.540225e-01 ( 1.4326955e-05-1.1097734e-05/mean )
Error is attributed to linear filter in frameAPI which pre-fetches many more seconds of data from NDAS frames than from raw frames.
Lal/Wrapper Version: test-2004-02-23
Regression tests FAIL 06/27/2008 ldas-dev ( sunbuild ) 1.9.346 Mary Lei Failures are from not finding a channel, FrCheck failed and frame data corruption. pr2008.tcl passed this time. No cores. See regression log. pr2953 run by user ldas failed when md5 sum in frame output directory cannot be found. Others run as install. 
Link Check PASS ? 06/27/2008 ldas-dev 1.9.346 Mary Lei List of bad links
Alternate report
Different from last week
Diskcache mangle PASS 06/30/2008 ldas-dev 1.9.346 Mary Lei  Expected caches to differ for /archive, /data and /scratch files that are changing.
Complex data in frames PASS ? 06/27/2008 ldas-dev 1.9.346 Mary Lei  FrCheck flags no file checksum.
Test lsync.tcl and shared objects PASS 06/27/2008 ldas-dev
(gateway/opterondata-dev)
1.9.346 Mary Lei Only 9 out of 10 cache compares passed. But the diffs directories are actually identical. This test is only run without /archive and /data in the mount points as these file systems are constantly having files added and lsync would never finish scanning. caches matched only when I issued a rebuild cache request at diskcache. Expected caches to differ only for some RDSVerify frame directories that does not have timestamp in diskcache. Must be run when there are no active updates to /archive. Otherwise a run does not come to an end. Wait for 20 iterations of directory scanning before comparing cache contents. Expected lsync.cache to agree with .frame.cache for the same mount points and excluded directories.
Test geo frames PASS ? 06/27/2008 ldas-dev 1.9.346 Mary Lei channel G1:DER_H_QUALITY only has 1 data point so cannot resample; G1:DER_H_HP-EP ok
Test all user commands via tcl socket PASS ? 06/27/2008 ldas-dev 1.9.346 Mary Lei 10 failures: getFrameElements channel_not_found ; dataPipelines need wrapper. Run TEST ALL CMDS from cmonClient with tcl socket as globus socket does not flush, causing abortJob cmd to not able to get jobId to abort
Frame to ilwd test FAIL 06/27/2008 ldas-dev 1.9.346 Mary Lei  getFrameDetectorProc failed.