When running RNASeq, Sarek, or FetchNGS pipelines as per the AWS tutorial Analyzing Genomic Data using Amazon Genomics CLI and Amazon SageMaker the AWS Batch run job is failing on the head node with Cannot find latest version of nf-validation plugin
Portion of log from Batch job:
N E X T F L O W ~ version 22.04.3
Pulling nf-core/sarek ...
downloaded from https://github.com/nf-core/sarek.git
WARN: It appears you have never run this project before -- Option -resume is ignored
Launching 'https://github.com/nf-core/sarek' [fabulous_volhard] DSL2 - revision: 6aeac929c9 [master]
Cannot find latest version of nf-validation plugin
Cannot find latest version of nf-validation plugin
=== Nextflow Log ===
=== Running Cleanup ===
Using:
- NextFlow 22.04.4
- AGC 1.6.0
- Running on Mac M1 with Sonoma 14.2 / also running from AWS SageMaker
- Node v20.1.0
- zsh version 5.9
Following along with above linked tutorial - AGC activate and context deploy fine
Pipeline fails at the validation - suggestions are to enter the validation module version manually to the nextflow.config - using AGC doesn't seem to allow this
Expect pipeline to complete as it does when built on an EC2 launcher using AWS Batch following the NextFlow tutorial as per NextFlow on AWS - I have this running successfully - was trying out AGC as a potential solution for an easily deployable contained module.
Operating System:
AGC Version: 1.6.0
Was AGC setup with a custom bucket: yes
Was AGC setup with a custom VPC: no
When running RNASeq, Sarek, or FetchNGS pipelines as per the AWS tutorial Analyzing Genomic Data using Amazon Genomics CLI and Amazon SageMaker the AWS Batch run job is failing on the head node with
Cannot find latest version of nf-validation pluginPortion of log from Batch job:
N E X T F L O W ~ version 22.04.3Pulling nf-core/sarek ...downloaded from https://github.com/nf-core/sarek.gitWARN: It appears you have never run this project before -- Option-resumeis ignoredLaunching 'https://github.com/nf-core/sarek' [fabulous_volhard] DSL2 - revision: 6aeac929c9 [master]Cannot find latest version of nf-validation pluginCannot find latest version of nf-validation plugin=== Nextflow Log ====== Running Cleanup ===Using:
Following along with above linked tutorial - AGC activate and context deploy fine
Pipeline fails at the validation - suggestions are to enter the validation module version manually to the nextflow.config - using AGC doesn't seem to allow this
Expect pipeline to complete as it does when built on an EC2 launcher using AWS Batch following the NextFlow tutorial as per NextFlow on AWS - I have this running successfully - was trying out AGC as a potential solution for an easily deployable contained module.
Operating System:
AGC Version: 1.6.0
Was AGC setup with a custom bucket: yes
Was AGC setup with a custom VPC: no