Redun

Here, we’ll see how to track redun workflow runs with LaminDB.

Note

This use case is based on github.com/ricomnl/bioinformatics-pipeline-tutorial.

# pip install lamindb redun git+http://github.com/laminlabs/redun-lamin-fasta
!lamin init --storage ./test-redun-lamin
Hide code cell output
 resetting django module variables
 initialized lamindb: testuser1/test-redun-lamin

Amend the workflow

import lamindb as ln
import json
Hide code cell output
 connected lamindb: testuser1/test-redun-lamin

Let’s amend a redun workflow.py to register input & output artifacts in LaminDB:

  • To track the workflow run in LaminDB, add (see on GitHub):

    ln.track(params=params)
    
  • To register the output file via LaminDB, add (see on GitHub):

    ln.Artifact(output_path, description="results").save()
    

Run redun

Let’s see what the input files are:

!ls ./fasta
Hide code cell output
KLF4.fasta  MYC.fasta  PO5F1.fasta  SOX2.fasta

And call the workflow:

!redun run workflow.py main --input-dir ./fasta --tag run=test-run  1> run_logs.txt 2>run_logs.txt

Inspect the logs:

!cat run_logs.txt
Hide code cell output
 connected lamindb: testuser1/test-redun-lamin
 created Transform('ZZL25qrwYfII0000'), started new Run('9UaRe41t...') at 2025-09-23 16:36:00 UTC
→ params: input_dir=./fasta, amino_acid=C, enzyme_regex=[KR], missed_cleavages=0, min_length=4, max_length=75, executor=Executor.default
 recommendation: to identify the script across renames, pass the uid: ln.track("ZZL25qrwYfII", params={...})
! folder i[redun] Run    Job da365a2c:  bioinformatics_pipeline_tutorial.lib.digest_protein_task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/ravuaeG1zxfkfb3O0000.fasta, hash=43cd048b), enzyme_regex='[KR]', missed_cleavages=0, min_length=4, mFile(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/results.tgz, hash=d1642b6e)
task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/XyEt1Gp966tgDX3M0000.fasta, hash=25c4ac2b), enzyme_regex='[KR]', missed_cleavages=0, min_length=4, max_length=75) on default
[redun] Run    Job b57b3b61:  bioinformatics_pipeline_tutorial.lib.digest_protein_task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/vwZiGbhkcHL0QsOL0000.fasta, hash=a622efaa), enzyme_regex='[KR]', missed_cleavages=0, min_length=4, max_length=75) on default
[redun] Run    Job 95282c61:  bioinformatics_pipeline_tutorial.lib.digest_protein_task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/3z7oh5H8NRyXNSOh0000.fasta, hash=2d243a69), enzyme_regex='[KR]', missed_cleavages=0, min_length=4, max_length=75) on default
[redun] Run    Job dd4ca48c:  bioinformatics_pipeline_tutorial.lib.count_amino_acids_task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/ravuaeG1zxfkfb3O0000.fasta, hash=43cd048b), input_peptides=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/ravuaeG1zxfkfb3O0000.peptides.txt, hash=7bda80d7), amino_acid='C') on default
[redun] Run    Job a739e1d4:  bioinformatics_pipeline_tutorial.lib.count_amino_acids_task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/XyEt1Gp966tgDX3M0000.fasta, hash=25c4ac2b), input_peptides=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/XyEt1Gp966tgDX3M0000.peptides.txt, hash=764a4cfc), amino_acid='C') on default
[redun] Run    Job 810b35f4:  bioinformatics_pipeline_tutorial.lib.count_amino_acids_task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/vwZiGbhkcHL0QsOL0000.fasta, hash=a622efaa), input_peptides=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/vwZiGbhkcHL0QsOL0000.peptides.txt, hash=826712c6), amino_acid='C') on default
[redun] Run    Job de6791e3:  bioinformatics_pipeline_tutorial.lib.count_amino_acids_task(input_fasta=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/.lamindb/3z7oh5H8NRyXNSOh0000.fasta, hash=2d243a69), input_peptides=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/3z7oh5H8NRyXNSOh0000.peptides.txt, hash=b09c8725), amino_acid='C') on default
[redun] Run    Job 0178973f:  bioinformatics_pipeline_tutorial.lib.plot_count_task(input_count=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/ravuaeG1zxfkfb3O0000.count.tsv, hash=2114915f)) on default
[redun] Run    Job 7bcd715a:  bioinformatics_pipeline_tutorial.lib.plot_count_task(input_count=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/XyEt1Gp966tgDX3M0000.count.tsv, hash=564f3a75)) on default
[redun] Run    Job 4b7c81c4:  bioinformatics_pipeline_tutorial.lib.plot_count_task(input_count=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/vwZiGbhkcHL0QsOL0000.count.tsv, hash=942f01cd)) on default
[redun] Run    Job 0058c976:  bioinformatics_pipeline_tutorial.lib.plot_count_task(input_count=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/3z7oh5H8NRyXNSOh0000.count.tsv, hash=ee695a72)) on default
[redun] Run    Job b32cebd3:  bioinformatics_pipeline_tutorial.lib.get_report_task(input_counts=[File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/ravuaeG1zxfkfb3O0000.count.tsv, hash=2114915f), File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-l...) on default
[redun] Run    Job 1b0fb82d:  bioinformatics_pipeline_tutorial.lib.archive_results_task(inputs_plots=[File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/ravuaeG1zxfkfb3O0000.plot.png, hash=d3f3ef63), File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-la..., input_report=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/protein_report.tsv, hash=60b49a67)) on default
INFO	redun:scheduler.py:log()- Run    Job 1b0fb82d:  bioinformatics_pipeline_tutorial.lib.archive_results_task(inputs_plots=[File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/ravuaeG1zxfkfb3O0000.plot.png, hash=d3f3ef63), File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-la..., input_report=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/protein_report.tsv, hash=60b49a67)) on default
[redun] Run    Job 23725e1d:  redun_lamin_fasta.finish(results_archive=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/results.tgz, hash=d1642b6e)) on default
INFO	redun:scheduler.py:log()- Run    Job 23725e1d:  redun_lamin_fasta.finish(results_archive=File(path=/home/runner/work/redun-lamin/redun-lamin/docs/test-redun-lamin/data/results.tgz, hash=d1642b6e)) on default
[redun] 
INFO	redun:scheduler.py:log()- 
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1301, in log_job_statuses
    self.log()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: ''
Arguments: ()
[redun] | JOB STATUS 2025/09/23 16:36:17
INFO	redun:scheduler.py:log()- | JOB STATUS 2025/09/23 16:36:17
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| JOB STATUS 2025/09/23 16:36:17'
Arguments: ()
[redun] | TASK                                                        PENDING RUNNING  FAILED  CACHED    DONE   TOTAL
INFO	redun:scheduler.py:log()- | TASK                                                        PENDING RUNNING  FAILED  CACHED    DONE   TOTAL
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| TASK                                                        PENDING RUNNING  FAILED  CACHED    DONE   TOTAL'
Arguments: ()
[redun] | 
INFO	redun:scheduler.py:log()- | 
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| '
Arguments: ()
[redun] | ALL                                                               0       0       0       0      16      16
INFO	redun:scheduler.py:log()- | ALL                                                               0       0       0       0      16      16
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| ALL                                                               0       0       0       0      16      16'
Arguments: ()
[redun] | bioinformatics_pipeline_tutorial.lib.archive_results_task         0       0       0       0       1       1
INFO	redun:scheduler.py:log()- | bioinformatics_pipeline_tutorial.lib.archive_results_task         0       0       0       0       1       1
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| bioinformatics_pipeline_tutorial.lib.archive_results_task         0       0       0       0       1       1'
Arguments: ()
[redun] | bioinformatics_pipeline_tutorial.lib.count_amino_acids_task       0       0       0       0       4       4
INFO	redun:scheduler.py:log()- | bioinformatics_pipeline_tutorial.lib.count_amino_acids_task       0       0       0       0       4       4
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| bioinformatics_pipeline_tutorial.lib.count_amino_acids_task       0       0       0       0       4       4'
Arguments: ()
[redun] | bioinformatics_pipeline_tutorial.lib.digest_protein_task          0       0       0       0       4       4
INFO	redun:scheduler.py:log()- | bioinformatics_pipeline_tutorial.lib.digest_protein_task          0       0       0       0       4       4
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| bioinformatics_pipeline_tutorial.lib.digest_protein_task          0       0       0       0       4       4'
Arguments: ()
[redun] | bioinformatics_pipeline_tutorial.lib.get_report_task              0       0       0       0       1       1
INFO	redun:scheduler.py:log()- | bioinformatics_pipeline_tutorial.lib.get_report_task              0       0       0       0       1       1
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| bioinformatics_pipeline_tutorial.lib.get_report_task              0       0       0       0       1       1'
Arguments: ()
[redun] | bioinformatics_pipeline_tutorial.lib.plot_count_task              0       0       0       0       4       4
INFO	redun:scheduler.py:log()- | bioinformatics_pipeline_tutorial.lib.plot_count_task              0       0       0       0       4       4
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| bioinformatics_pipeline_tutorial.lib.plot_count_task              0       0       0       0       4       4'
Arguments: ()
[redun] | redun_lamin_fasta.finish                                          0       0       0       0       1       1
INFO	redun:scheduler.py:log()- | redun_lamin_fasta.finish                                          0       0       0       0       1       1
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| redun_lamin_fasta.finish                                          0       0       0       0       1       1'
Arguments: ()
[redun] | redun_lamin_fasta.main                                            0       0       0       0       1       1
INFO	redun:scheduler.py:log()- | redun_lamin_fasta.main                                            0       0       0       0       1       1
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: '| redun_lamin_fasta.main                                            0       0       0       0       1       1'
Arguments: ()
[redun] 
INFO	redun:scheduler.py:log()- 
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1303, in log_job_statuses
    self.log(report_line)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: ''
Arguments: ()
[redun] 
INFO	redun:scheduler.py:log()- 
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1078, in _run
    self._process_events(result)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1282, in _process_events
    self.log_job_statuses()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1304, in log_job_statuses
    self.log()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: ''
Arguments: ()
[redun] Execution duration: 17.30 seconds
INFO	redun:scheduler.py:log()- Execution duration: 17.30 seconds
--- Logging error ---
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/logging/__init__.py", line 1163, in emit
    stream.write(msg + self.terminator)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/lamindb/core/_context.py", line 120, in write
    self.file.write(data)
ValueError: I/O operation on closed file.
Call stack:
  File "/opt/hostedtoolcache/Python/3.12.11/x64/bin/redun", line 10, in <module>
    client.execute()
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 923, in execute
    return args.func(args, extra_args, argv)
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/cli.py", line 1626, in run_command
    result = scheduler.run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1164, in run
    result: Promise[Result] = self._run(
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1082, in _run
    self.log(f"Execution duration: {duration:.2f} seconds")
  File "/opt/hostedtoolcache/Python/3.12.11/x64/lib/python3.12/site-packages/redun/scheduler.py", line 1028, in log
    self.logger.log(level, (" " * indent) + line)
Message: 'Execution duration: 17.30 seconds'
Arguments: ()

View data lineage:

artifact = ln.Artifact.get(key="data/results.tgz")
artifact.view_lineage()
Hide code cell output
_images/65bef920890bb37ef49b59b1e1a0391b3ee2157953fe422e4a245c9d97bd1933.svg

Track the redun execution id

If we want to be able to query LaminDB for redun execution ID, this here is a way to get it:

# export the run information from redun
!redun log --exec --exec-tag run=test-run --format json --no-pager > redun_exec.json
# load the redun execution id from the JSON and store it in the LaminDB run record
with open("redun_exec.json") as file:
    redun_exec = json.loads(file.readline())
artifact.run.reference = redun_exec["id"]
artifact.run.reference_type = "redun_id"
artifact.run.save()
Run(uid='9UaRe41tdoUym3BY', started_at=2025-09-23 16:36:00 UTC, finished_at=2025-09-23 16:36:17 UTC, reference='c58cff48-c0cd-4a0b-b6e6-15274104adbf', reference_type='redun_id', branch_id=1, space_id=1, transform_id=1, report_id=7, environment_id=1, created_by_id=1, created_at=2025-09-23 16:36:00 UTC)

Track the redun run report

Attach a run report:

report = ln.Artifact(
    "run_logs.txt",
    description=f"Redun run report of {redun_exec['id']}",
    run=False,
    visibility=0,
).save()
artifact.run.report = report
artifact.run.save()
Run(uid='9UaRe41tdoUym3BY', started_at=2025-09-23 16:36:00 UTC, finished_at=2025-09-23 16:36:17 UTC, reference='c58cff48-c0cd-4a0b-b6e6-15274104adbf', reference_type='redun_id', branch_id=1, space_id=1, transform_id=1, report_id=8, environment_id=1, created_by_id=1, created_at=2025-09-23 16:36:00 UTC)

View transforms and runs in LaminHub

hub

View the database content

ln.view()
Hide code cell output
Artifact
uid key description suffix kind otype size hash n_files n_observations _hash_type _key_is_virtual _overwrite_versions space_id storage_id schema_id version is_latest run_id created_at created_by_id _aux branch_id
id
8 inGfA3DQmQmIoFY40000 None Redun run report of c58cff48-c0cd-4a0b-b6e6-15... .txt None None 33584 vRkV2hdGD6X91juz_NsJWA None None md5 True False 1 1 None None True NaN 2025-09-23 16:36:19.740000+00:00 1 {'af': {'0': True}} 1
6 lUb2dRA6q7yF3CpI0000 data/results.tgz None .tgz None None 85116 0HXNyrfCa-BE-LGwBLrLLA None None md5 False False 1 1 None None True 1.0 2025-09-23 16:36:17.278000+00:00 1 None 1
4 vwZiGbhkcHL0QsOL0000 fasta/PO5F1.fasta None .fasta None None 477 -7iJgveFO9ia0wE1bqVu6g None None md5 True False 1 1 None None True NaN 2025-09-23 16:36:01.105000+00:00 1 {'af': {'0': True}} 1
5 3z7oh5H8NRyXNSOh0000 fasta/MYC.fasta None .fasta None None 536 WGbEtzPw-3bQEGcngO_pHQ None None md5 True False 1 1 None None True NaN 2025-09-23 16:36:01.105000+00:00 1 {'af': {'0': True}} 1
2 ravuaeG1zxfkfb3O0000 fasta/SOX2.fasta None .fasta None None 414 C5q_yaFXGk4SAEpfdqBwnQ None None md5 True False 1 1 None None True NaN 2025-09-23 16:36:01.104000+00:00 1 {'af': {'0': True}} 1
3 XyEt1Gp966tgDX3M0000 fasta/KLF4.fasta None .fasta None None 609 LyuoYkWs4SgYcH7P7JLJtA None None md5 True False 1 1 None None True NaN 2025-09-23 16:36:01.104000+00:00 1 {'af': {'0': True}} 1
Feature
uid name dtype is_type unit description array_rank array_size array_shape proxy_dtype synonyms _expect_many _curation space_id type_id run_id created_at created_by_id _aux branch_id
id
1 RjfS6CMXhPzK input_dir str None None None 0 0 None None None None None 1 None None 2025-09-23 16:36:00.294000+00:00 1 {'af': {'0': None, '1': True, '2': False}} 1
2 xiSEApsgX0SR amino_acid str None None None 0 0 None None None None None 1 None None 2025-09-23 16:36:00.294000+00:00 1 {'af': {'0': None, '1': True, '2': False}} 1
3 YhJI7uWL1hbn enzyme_regex str None None None 0 0 None None None None None 1 None None 2025-09-23 16:36:00.294000+00:00 1 {'af': {'0': None, '1': True, '2': False}} 1
4 VUqrwVsXWdkf missed_cleavages int None None None 0 0 None None None None None 1 None None 2025-09-23 16:36:00.294000+00:00 1 {'af': {'0': None, '1': True, '2': False}} 1
5 T9u9jwYShgfD min_length int None None None 0 0 None None None None None 1 None None 2025-09-23 16:36:00.294000+00:00 1 {'af': {'0': None, '1': True, '2': False}} 1
6 GAi8d4K0Ur7w max_length int None None None 0 0 None None None None None 1 None None 2025-09-23 16:36:00.294000+00:00 1 {'af': {'0': None, '1': True, '2': False}} 1
7 n8BhZ4Ndu6E1 executor str None None None 0 0 None None None None None 1 None None 2025-09-23 16:36:00.294000+00:00 1 {'af': {'0': None, '1': True, '2': False}} 1
FeatureValue
value hash space_id feature_id run_id created_at created_by_id _aux branch_id
id
1 ./fasta G8diGhDfCu78R1WbXfsHOw 1 1 None 2025-09-23 16:36:00.419000+00:00 1 None 1
2 C DWH4NwytHUEvgLhNFD4SVw 1 2 None 2025-09-23 16:36:00.421000+00:00 1 None 1
3 [KR] zPuapwAPylpfWRQFOTw9Cg 1 3 None 2025-09-23 16:36:00.422000+00:00 1 None 1
4 0 z80ghJXVZe9m59_5-Ydk2g 1 4 None 2025-09-23 16:36:00.424000+00:00 1 None 1
5 4 qH_2eaLz5x2RgaZ7dUISLA 1 5 None 2025-09-23 16:36:00.425000+00:00 1 None 1
6 75 0Jv0FUSjNlpGyQd-u141ww 1 6 None 2025-09-23 16:36:00.427000+00:00 1 None 1
7 Executor.default BaNJiQQLvaFrvOtdglHU7w 1 7 None 2025-09-23 16:36:00.428000+00:00 1 None 1
Run
uid name started_at finished_at reference reference_type _is_consecutive _status_code space_id transform_id report_id _logfile_id environment_id initiated_by_run_id created_at created_by_id _aux branch_id
id
1 9UaRe41tdoUym3BY None 2025-09-23 16:36:00.307133+00:00 2025-09-23 16:36:17.305917+00:00 c58cff48-c0cd-4a0b-b6e6-15274104adbf redun_id True 0 1 1 8 None 1 None 2025-09-23 16:36:00.307000+00:00 1 None 1
Storage
uid root description type region instance_uid space_id run_id created_at created_by_id _aux branch_id
id
1 VUXKzdgRncUp /home/runner/work/redun-lamin/redun-lamin/docs... None local None iQlBPgD8uaqR 1 None 2025-09-23 16:35:42.924000+00:00 1 None 1
Transform
uid key description type source_code hash reference reference_type space_id _template_id version is_latest created_at created_by_id _aux branch_id
id
1 ZZL25qrwYfII0000 workflow.py workflow.py script """workflow.py."""\n\n# This code is a copy fr... mHyxrE622q2fluxICu4XDw None None 1 None None True 2025-09-23 16:36:00.305000+00:00 1 None 1

Delete the test instance:

Hide code cell content
!rm -rf test-redun-lamin
!lamin delete --force test-redun-lamin
 deleting instance testuser1/test-redun-lamin