logging bug: file upload list gets repeated for each uploaded file
instead please just show the whole list once in the beginning. then just notify per file when each upload is finished.
2022-10-11 17:41:10,959 - Loosolab_s3_logger - INFO - Bucket igvdata-bulk-atac-seq-zhou10 was created!
2022-10-11 17:41:11,002 - Loosolab_s3_logger - INFO - All files are uploaded!['/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/igv/resources/defaultSession.json', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/igv/resources/mySessionRegistry.json', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_1_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_2_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_1_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_2_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_1_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_2_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_1_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_2_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO_in.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO_in.bam.bai', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO.bam.bai', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT_in.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT_in.bam.bai', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT.bam.bai']
2022-10-11 17:41:11,036 - Loosolab_s3_logger - INFO - All files are uploaded!['/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/igv/resources/defaultSession.json', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/igv/resources/mySessionRegistry.json', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_1_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_2_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_1_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/KO_2_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_1_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_2_in_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_1_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bw/WT_2_libnorm.bw', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO_in.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO_in.bam.bai', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/KO.bam.bai', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT_in.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT_in.bam.bai', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT.bam', '/mnt/d/develop/pipelines/chipseq/yua48/chip.20220714.buster/final/bam/WT.bam.bai']
...
Edited by Carsten Kuenne