File size changes due to changes in default compression in v1.6.2? #1408
Description
When loading data with the latest version (v1.6.2) I get an ifgramStack.h5 with different size than previously. I get np.int64(113), np.int64(140) while with v1.6.1 I get np.int64(137), np.int64(164) as shown below. It now says compression: default while previously it said compression: None.
Were there any changes in the defaults or could that be related to our setup? The Fernandina test data do say compression: default while previously compression: None, but don't show a change in sizes.
Version 1.6.2:
smallbaselineApp.py --version
MintPy version 1.6.2, date 2025-07-07
load_data.py -t smallbaselineApp.cfg
processor : isce
SAR platform/sensor : unknown from project name "None"
use auto path defined in mintpy.defaults.auto_path for options in auto
mintpy.load.metaFile : auto --> ../reference/IW*.xml
mintpy.load.baselineDir : auto --> ../baselines
mintpy.load.unwFile : auto --> ../merged/interferograms/*/filt*.unw
mintpy.load.corFile : auto --> ../merged/interferograms/*/filt*.cor
mintpy.load.connCompFile : auto --> ../merged/interferograms/*/filt*.unw.conncomp
mintpy.load.ionUnwFile : auto --> ../ion/*/ion_cal/filt.ion
mintpy.load.ionCorFile : auto --> ../ion/*/ion_cal/raw_no_projection.cor
mintpy.load.demFile : auto --> ../merged/geom_reference/hgt.rdr
mintpy.load.lookupYFile : auto --> ../merged/geom_reference/lat.rdr
mintpy.load.lookupXFile : auto --> ../merged/geom_reference/lon.rdr
mintpy.load.incAngleFile : auto --> ../merged/geom_reference/los.rdr
mintpy.load.azAngleFile : auto --> ../merged/geom_reference/los.rdr
mintpy.load.shadowMaskFile : auto --> ../merged/geom_reference/shadowMask.rdr
mintpy.load.waterMaskFile : auto --> ../merged/geom_reference/waterMask.rdr
--------------------------------------------------
prepare metadata files for isce products
prep_isce.py -m ../reference/IW1.xml -g /scratch/05861/tg851601/unittestGalapagosSenDT128/merged/geom_reference -b ../baselines -f "../merged/interferograms/*/filt*.unw" --geom-files hgt.rdr lat.rdr lon.rdr los.rdr los.rdr shadowMask.rdr waterMask.rdr
['../reference/data.rsc'] exists and is newer than ['../reference/IW1.xml'] --> skip.
preparing RSC file for geometry files
read perp baseline time-series from ../baselines
preparing RSC file for: ../merged/interferograms/*/filt*.unw
[==================================================] 20160816_20160828 15/15 0s / 0s
Done.
--------------------------------------------------
updateMode : True
compression: default
multilook x/ystep: 1/1
multilook method : nearest
input bounding box of interest in lat/lon: (-91.19, -0.81, -91.13, -0.86)
box to read for datasets in y/x: (np.int64(460), np.int64(292), np.int64(600), np.int64(405))
--------------------------------------------------
searching geometry files info
input data files:
height : ../merged/geom_reference/hgt.rdr
latitude : ../merged/geom_reference/lat.rdr
longitude : ../merged/geom_reference/lon.rdr
incidenceAngle : ../merged/geom_reference/los.rdr
azimuthAngle : ../merged/geom_reference/los.rdr
shadowMask : ../merged/geom_reference/shadowMask.rdr
--------------------------------------------------
create HDF5 file /scratch/05861/tg851601/unittestGalapagosSenDT128/mintpy/inputs/geometryRadar.h5 with w mode
create dataset /height of <class 'numpy.float32'> in size of (np.int64(113), np.int64(140)) with compression = lzf
create dataset /latitude of <class 'numpy.float32'> in size of (np.int64(113), np.int64(140)) with compression = lzf
create dataset /longitude of <class 'numpy.float32'> in size of (np.int64(113), np.int64(140)) with compression = lzf
create dataset /incidenceAngle of <class 'numpy.float32'> in size of (np.int64(113), np.int64(140)) with compression = lzf
create dataset /azimuthAngle of <class 'numpy.float32'> in size of (np.int64(113), np.int64(140)) with compression = lzf
create dataset /shadowMask of <class 'numpy.bool'> in size of (np.int64(113), np.int64(140)) with compression = lzf
Version 1.6.1
smallbaselineApp.py --version
MintPy version 1.6.1, date 2024-07-31
load_data.py -t smallbaselineApp.cfg
processor : isce
SAR platform/sensor : unknown from project name "None"
use auto path defined in mintpy.defaults.auto_path for options in auto
mintpy.load.metaFile : auto --> ../reference/IW*.xml
mintpy.load.baselineDir : auto --> ../baselines
mintpy.load.unwFile : auto --> ../merged/interferograms/*/filt*.unw
mintpy.load.corFile : auto --> ../merged/interferograms/*/filt*.cor
mintpy.load.connCompFile : auto --> ../merged/interferograms/*/filt*.unw.conncomp
mintpy.load.ionUnwFile : auto --> ../ion/*/ion_cal/filt.ion
mintpy.load.ionCorFile : auto --> ../ion/*/ion_cal/raw_no_projection.cor
mintpy.load.demFile : auto --> ../merged/geom_reference/hgt.rdr
mintpy.load.lookupYFile : auto --> ../merged/geom_reference/lat.rdr
mintpy.load.lookupXFile : auto --> ../merged/geom_reference/lon.rdr
mintpy.load.incAngleFile : auto --> ../merged/geom_reference/los.rdr
mintpy.load.azAngleFile : auto --> ../merged/geom_reference/los.rdr
mintpy.load.shadowMaskFile : auto --> ../merged/geom_reference/shadowMask.rdr
mintpy.load.waterMaskFile : auto --> ../merged/geom_reference/waterMask.rdr
--------------------------------------------------
prepare metadata files for isce products
prep_isce.py -m ../reference/IW1.xml -g /scratch/05861/tg851601/unittestGalapagosSenDT128/merged/geom_reference -b ../baselines -f "../merged/interferograms/*/filt*.unw" --geom-files hgt.rdr lat.rdr lon.rdr los.rdr los.rdr shadowMask.rdr waterMask.rdr
['../reference/data.rsc'] exists and is newer than ['../reference/IW1.xml'] --> skip.
preparing RSC file for geometry files
read perp baseline time-series from ../baselines
preparing RSC file for: ../merged/interferograms/*/filt*.unw
[==================================================] 20160816_20160828 15/15 0s / 0s
Done.
--------------------------------------------------
updateMode : True
compression: None
multilook x/ystep: 1/1
multilook method : nearest
input bounding box of interest in lalo: (-91.19, -0.81, -91.13, -0.86)
box to read for datasets in y/x: (np.int64(448), np.int64(280), np.int64(612), np.int64(417))
--------------------------------------------------
searching geometry files info
input data files:
height : ../merged/geom_reference/hgt.rdr
latitude : ../merged/geom_reference/lat.rdr
longitude : ../merged/geom_reference/lon.rdr
incidenceAngle : ../merged/geom_reference/los.rdr
azimuthAngle : ../merged/geom_reference/los.rdr
shadowMask : ../merged/geom_reference/shadowMask.rdr
--------------------------------------------------
create directory: /scratch/05861/tg851601/unittestGalapagosSenDT128/mintpy_trynew/inputs
create HDF5 file /scratch/05861/tg851601/unittestGalapagosSenDT128/mintpy_trynew/inputs/geometryRadar.h5 with w mode
create dataset /height of <class 'numpy.float32'> in size of (np.int64(137), np.int64(164)) with compression = lzf
create dataset /latitude of <class 'numpy.float32'> in size of (np.int64(137), np.int64(164)) with compression = lzf
create dataset /longitude of <class 'numpy.float32'> in size of (np.int64(137), np.int64(164)) with compression = lzf
create dataset /incidenceAngle of <class 'numpy.float32'> in size of (np.int64(137), np.int64(164)) with compression = lzf
create dataset /azimuthAngle of <class 'numpy.float32'> in size of (np.int64(137), np.int64(164)) with compression = lzf
create dataset /shadowMask of <class 'numpy.bool'> in size of (np.int64(137), np.int64(164)) with compression = lzf