Gene Ontology (GO)¶
Pathways represent interconnected molecular networks of signaling cascades that govern critical cellular processes. They provide understandings cellular behavior mechanisms, insights of disease progression and treatment responses. In an R&D organization, managing pathways across different datasets are crucial for gaining insights of potential therapeutic targets and intervention strategies.
In this notebook we manage a pathway registry based on “2023 GO Biological Process” ontology. We’ll walk you through the steps of registering pathways and link them to genes.
In the following Standardize metadata on-the-fly notebook, we’ll demonstrate how to perform a pathway enrichment analysis and track the dataset with LaminDB.
# !pip install 'lamindb[jupyter,bionty]'
!lamin init --storage ./use-cases-registries --schema bionty
Show code cell output
→ initialized lamindb: testuser1/use-cases-registries
import lamindb as ln
import bionty as bt
import gseapy as gp
bt.settings.organism = "human" # globally set organism
→ connected lamindb: testuser1/use-cases-registries
Fetch GO pathways annotated with human genes using Enrichr¶
First we fetch the “GO_Biological_Process_2023” pathways for humans using GSEApy which wraps GSEA and Enrichr.
go_bp = gp.get_library(name="GO_Biological_Process_2023", organism="Human")
print(f"Number of pathways {len(go_bp)}")
Number of pathways 5406
go_bp["ATF6-mediated Unfolded Protein Response (GO:0036500)"]
['MBTPS1', 'MBTPS2', 'XBP1', 'ATF6B', 'DDIT3', 'CREBZF']
Parse out the ontology_id from keys, convert into the format of {ontology_id: (name, genes)}
def parse_ontology_id_from_keys(key):
"""Parse out the ontology id.
"ATF6-mediated Unfolded Protein Response (GO:0036500)" -> ("GO:0036500", "ATF6-mediated Unfolded Protein Response")
"""
name, id = key.rsplit(" (", 1)
id = id.rstrip(")")
return id, name
go_bp_parsed = {}
for key, genes in go_bp.items():
id, name = parse_ontology_id_from_keys(key)
go_bp_parsed[id] = (name, genes)
go_bp_parsed["GO:0036500"]
('ATF6-mediated Unfolded Protein Response',
['MBTPS1', 'MBTPS2', 'XBP1', 'ATF6B', 'DDIT3', 'CREBZF'])
Register pathway ontology in LaminDB¶
bionty = bt.Pathway.public()
bionty
Show code cell output
PublicOntology
Entity: Pathway
Organism: all
Source: go, 2024-06-17
#terms: 47856
Next, we register all the pathways and genes in LaminDB to finally link pathways to genes.
Register pathway terms¶
To register the pathways we make use of .from_values to directly parse the annotated GO pathway ontology IDs into LaminDB.
pathway_records = bt.Pathway.from_values(go_bp_parsed.keys(), bt.Pathway.ontology_id)
ln.save(pathway_records)
Register gene symbols¶
Similarly, we use .from_values for all Pathway associated genes to register them with LaminDB.
all_genes = bt.Gene.standardize(list({g for genes in go_bp.values() for g in genes}))
gene_records = bt.Gene.from_values(all_genes, bt.Gene.symbol)
ln.save(gene_records);
! found 56 synonyms in Bionty (output truncated): [np.str_('C8ORF17'), np.str_('FAM172BP'), np.str_('C1ORF131'), np.str_('C2ORF49'), np.str_('TTC30A'), np.str_('C1ORF68'), np.str_('TRB'), np.str_('SPATA5'), np.str_('C1ORF146'), np.str_('C19ORF12'), '...']
please add corresponding Gene records via (output truncated): `.from_values([np.str_('C8ORF17'), np.str_('FAM172BP'), np.str_('C1ORF131'), np.str_('C2ORF49'), np.str_('TTC30A'), np.str_('C1ORF68'), np.str_('TRB'), np.str_('SPATA5'), np.str_('C1ORF146'), np.str_('C19ORF12'), '...'])`
! ambiguous validation in Bionty for 1104 records: 'TFPT', 'DDX52', 'SOCS7', 'MATR3', 'OR12D2', 'NXNL2', 'UBL7', 'IGHG4', 'PCDHA7', 'FLII', 'SLC39A4', 'TMEM50B', 'DHRS4L2', 'LEUTX', 'CEACAM21', 'ADAM32', 'ARHGEF26', 'TTYH1', 'SPATC1L', 'CEP72', ...
! did not create Gene records for 38 non-validated symbols: 'AFD1', 'AZF1', 'CCL3L1', 'CCL4L1', 'DGS2', 'DUX3', 'DUX5', 'FOXL3-OT1', 'IGL', 'LOC100653049', 'LOC102723475', 'LOC102723996', 'LOC102724159', 'LOC107984156', 'LOC112268384', 'LOC122319436', 'LOC122513141', 'LOC122539214', 'LOC344967', 'MDRV', ...
Manually register the 37 non-validated symbols:
inspect_result = bt.Gene.inspect(all_genes, bt.Gene.symbol)
nonval_genes = []
for g in inspect_result.non_validated:
nonval_genes.append(bt.Gene(symbol=g))
ln.save(nonval_genes)
! received 14696 unique terms, 1 empty/duplicated term is ignored
! 38 unique terms (0.30%) are not validated for symbol: 'MTRNR2L4', 'LOC102723996', 'DUX3', 'MTRNR2L3', 'LOC112268384', 'CCL4L1', 'LOC122513141', 'LOC122319436', 'TRA', 'LOC344967', ...
couldn't validate 38 terms: 'MTRNR2L4', 'TRL-AAG2-3', 'SEPTIN14P20', 'AZF1', 'MTRNR2L5', 'DGS2', 'LOC112268384', 'TRA', 'LOC100653049', 'LOC122539214', 'CCL3L1', 'IGL', 'MTRNR2L3', 'CCL4L1', 'TAS2R33', 'LOC344967', 'MTRNR2L10', 'FOXL3-OT1', 'LOC107984156', 'DUX5', ...
→ if you are sure, create new records via Gene() and save to your registry
! records with similar symbols exist! did you mean to load one of them?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 5013 | TfqHfw8FjZxq | CCL4 | None | ENSG00000275302 | 6351 | protein_coding | MIP-1-BETA|SCYA4|AT744.1|LAG1|ACT-2 | C-C motif chemokine ligand 4 | 1 | 11 | 1 | None | 2025-01-24 13:57:31.011000+00:00 | 1 | None | 1 |
| 5014 | 2MLaX8EEZ9sQ | CCL4 | None | ENSG00000275824 | 6351 | protein_coding | MIP-1-BETA|SCYA4|AT744.1|LAG1|ACT-2 | C-C motif chemokine ligand 4 | 1 | 11 | 1 | None | 2025-01-24 13:57:31.011000+00:00 | 1 | None | 1 |
| 5015 | 7P74Aze5sMxb | CCL4 | None | ENSG00000277943 | 6351 | protein_coding | MIP-1-BETA|SCYA4|AT744.1|LAG1|ACT-2 | C-C motif chemokine ligand 4 | 1 | 11 | 1 | None | 2025-01-24 13:57:31.011000+00:00 | 1 | None | 1 |
! records with similar symbols exist! did you mean to load one of them?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 32 | 36rFUjNAnmMV | TRAF2 | None | ENSG00000127191 | 7186 | protein_coding | TRAP3|RNF117 | TNF receptor associated factor 2 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.595000+00:00 | 1 | None | 1 |
| 381 | 1ZHg8BbO0uI8 | TRAF4 | None | ENSG00000076604 | 9618 | protein_coding | MLN62|RNF83|CART1 | TNF receptor associated factor 4 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.624000+00:00 | 1 | None | 1 |
| 609 | 011JkY43zeO0 | TRAPPC6B | None | ENSG00000182400 | 122553 | protein_coding | trafficking protein particle complex subunit 6B | 1 | 11 | 1 | None | 2025-01-24 13:57:30.642000+00:00 | 1 | None | 1 |
! records with similar symbols exist! did you mean to load one of them?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 883 | 6OCQBErvXIf0 | TAS2R14 | None | ENSG00000212127 | 50840|106707243 | protein_coding | T2R14|TRB1 | taste 2 receptor member 14 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.666000+00:00 | 1 | None | 1 |
| 884 | 2P33YaKJTnkq | TAS2R14 | None | ENSG00000261984 | 50840|106707243 | protein_coding | T2R14|TRB1 | taste 2 receptor member 14 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.666000+00:00 | 1 | None | 1 |
| 885 | 41taVFXldpPZ | TAS2R14 | None | ENSG00000276541 | 106707243|50840 | protein_coding | T2R14|TRB1 | taste 2 receptor member 14 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.666000+00:00 | 1 | None | 1 |
! record with similar symbol exists! did you mean to load it?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 9174 | 217N4Hgazwqu | JAZF1 | None | ENSG00000153814 | 221895 | protein_coding | TIP27|ZNF802|DKFZP761K2222 | JAZF zinc finger 1 | 1 | 11 | 1 | None | 2025-01-24 13:57:31.555000+00:00 | 1 | None | 1 |
! records with similar symbols exist! did you mean to load one of them?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 6673 | 2qFUCnrrxPlc | IGLC7 | None | ENSG00000211685 | IG_C_gene | immunoglobulin lambda constant 7 | 1 | 11 | 1 | None | 2025-01-24 13:57:31.340000+00:00 | 1 | None | 1 | ||
| 7494 | 7TBpxi4zzmMB | IGLC3 | None | ENSG00000211679 | IG_C_gene | IGLC | immunoglobulin lambda constant 3 (Kern-Oz+ mar... | 1 | 11 | 1 | None | 2025-01-24 13:57:31.410000+00:00 | 1 | None | 1 | |
| 14228 | 10LbfkUokHgx | IGLC1 | None | ENSG00000211675 | IG_C_gene | IGLC | immunoglobulin lambda constant 1 | 1 | 11 | 1 | None | 2025-01-24 13:57:32.172000+00:00 | 1 | None | 1 |
! record with similar symbol exists! did you mean to load it?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 10488 | 19ZTVOfazMYF | SEPTIN14 | None | ENSG00000154997 | 346288 | protein_coding | SEPT14|FLJ44060 | septin 14 | 1 | 11 | 1 | None | 2025-01-24 13:57:31.665000+00:00 | 1 | None | 1 |
! records with similar symbols exist! did you mean to load one of them?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 3116 | F36vWNagki41 | CCL3 | None | ENSG00000274221 | 6348 | protein_coding | LD78|G0S19-1|SCYA3|LD78ALPHA|SCI|MIP-1-ALPHA | C-C motif chemokine ligand 3 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.846000+00:00 | 1 | None | 1 |
| 3117 | EBoWJxh70guC | CCL3 | None | ENSG00000277632 | 6348 | protein_coding | LD78|G0S19-1|SCYA3|LD78ALPHA|SCI|MIP-1-ALPHA | C-C motif chemokine ligand 3 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.846000+00:00 | 1 | None | 1 |
| 3118 | 6XmKAksx3Nn4 | CCL3 | None | ENSG00000278567 | 6348 | protein_coding | LD78|G0S19-1|SCYA3|LD78ALPHA|SCI|MIP-1-ALPHA | C-C motif chemokine ligand 3 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.846000+00:00 | 1 | None | 1 |
! records with similar symbols exist! did you mean to load one of them?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 883 | 6OCQBErvXIf0 | TAS2R14 | None | ENSG00000212127 | 50840|106707243 | protein_coding | T2R14|TRB1 | taste 2 receptor member 14 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.666000+00:00 | 1 | None | 1 |
| 884 | 2P33YaKJTnkq | TAS2R14 | None | ENSG00000261984 | 50840|106707243 | protein_coding | T2R14|TRB1 | taste 2 receptor member 14 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.666000+00:00 | 1 | None | 1 |
| 885 | 41taVFXldpPZ | TAS2R14 | None | ENSG00000276541 | 106707243|50840 | protein_coding | T2R14|TRB1 | taste 2 receptor member 14 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.666000+00:00 | 1 | None | 1 |
! record with similar symbol exists! did you mean to load it?
| uid | symbol | stable_id | ensembl_gene_id | ncbi_gene_ids | biotype | synonyms | description | space_id | source_id | organism_id | run_id | created_at | created_by_id | _aux | _branch_code | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| id | ||||||||||||||||
| 1001 | 2Z2LBAj16utl | TRAFD1 | None | ENSG00000135148 | 10906 | protein_coding | FLN29 | TRAF-type zinc finger domain containing 1 | 1 | 11 | 1 | None | 2025-01-24 13:57:30.675000+00:00 | 1 | None | 1 |
Link pathway to genes¶
Now that we are tracking all pathways and genes records, we can link both of them to make the pathways even more queryable.
symbols_gene_records = {record.symbol: record for record in gene_records}
for pathway_record in pathway_records:
pathway_genes = go_bp_parsed.get(pathway_record.ontology_id)[1]
pathway_genes_records = [symbols_gene_records.get(gene) for gene in pathway_genes]
pathway_record.genes.set(pathway_genes_records)
Now genes are linked to pathways:
pathway_record.genes.list("symbol")
['CARD18', 'CST7', 'CARD8', 'CAST', 'XIAP']
pathway_record.genes.list("ensembl_gene_id")
['ENSG00000255501',
'ENSG00000077984',
'ENSG00000105483',
'ENSG00000153113',
'ENSG00000101966']
Move on to the next analysis: Standardize metadata on-the-fly