Compression test

Test Objectives

Test frame data compression: verify that the compressed data stores the same information as raw data.

APIs affected by this test

managerAPI: directs processing of the insertion user commands to other APIs and returns the user command status to the user.
diskcacheAPI:
- Retrieves the frame file names required by the frame query in ldas command.
frameAPI:
- Retrives the frame data specified

Setup

ligotools package is required for running this test. Check that it is mounted

Install the following tests script in a directory on your local machine or the ldas system

compresstest.tcl


	
        compression types and levels 
            raw 1
            gzip 9
            gzip_diff 9
            zero_suppress_int_float 1
            diff_zero_suppress_short 1

S3 frame files must be mounted on ldas system and known to diskcacheAPI:


        Test Execution

		cd <your scripts directory>

		
        Usage: compresstest.tcl [options] >& compresstest.log & 

        

            
                Option
                Description
			

                <-v>
                verbose
            

                <-s>
                ldas site e.g. dev, llo, cit, ldas-suntest3 
        
e.g.

            compresstest.tcl -s dev >& compresstest.log &
        
		
		
Test Validation:
        The script issues a createRDS job with various compression types and ratios.
        It also retrieves the compressed frame data via a getFrameData on the output.
        The compressed data is 'diff'ed to the raw frame to make sure the same information
        is stored.
        
		When test has completed, check the end for expected passes and failures. 
        Two types of compression still fails; examples of passed and failed jobs: 

        e.g. 

        Compression Type : gzip_diff
        Compression Level: 9
        LDAS-DEV31916129 (1.2.3)
        File Size: 16799917
        Frame Time: 22.7
        LDAS-DEV31916147 (1.2.3)
        Frame Time: 31.76
        ++++ gzip_diff:9 PASSED
        
        Compression Type : zero_suppress_int_float
        Compression Level: 1
        LDAS-DEV31916157 (1.2.3)

        ==== zero_suppress_int_float:1  FAILED
        ==== Test generated error:
        Error from LDAS: frame::createRDSFrames: error: Compression type ZERO_SUPPRESS_INT_FLOAT is not supported!

        ldas-dev running LDAS version 1.2.3
        ---- Result should have been:
        0
        ==== zero_suppress_int_float:1 FAILED


        Compression Type : diff_zero_suppress_short
        Compression Level: 1
        LDAS-DEV31916160 (1.2.3)

        ==== diff_zero_suppress_short:1  FAILED
        ==== Test generated error:
        Error from LDAS: frame::createRDSFrames: error: Compression type DIFF_ZERO_SUPPRESS_SHORT is not supported!

        ldas-dev running LDAS version 1.2.3
        ---- Result should have been:
        0
        ==== diff_zero_suppress_short:1 FAILED
        
        
        As of ldas 1.2.3 here are the expected results:
        e.g. 

        compresstest.tcl:       Total   21      Passed  19      Skipped 0       Failed  2

Option	Description
`<-v>`	verbose
`<-s>`	ldas site e.g. dev, llo, cit, ldas-suntest3