Text-mining with the SimText toolset
OverviewQuestions:Objectives:
How can I automatically collect PubMed data for a set of biomedical entities such as genes?
How can I analyze similarities among biomedical entities based on PubMed data on large-scale?
Requirements:
Learn how to use the SimText toolset
Upload a table with biomedical entities in Galaxy
Retrieve PubMed data for each of the biomedical entities
Extract biomedical terms from the PubMed data for each biomedical entity
Analyze the similarity among the biomedical entities based on the extracted data in an interactive app
Time estimation: 1 hourSupporting Materials:Last modification: Oct 18, 2022
Introduction
Literature exploration in PubMed on a large number of biomedical entities (e.g., genes, diseases, or experiments) can be time-consuming and challenging, especially when assessing associations between entities. Here, we use SimText, a toolset for literature research that allows you to collect text from PubMed for any given set of biomedical entities, extract associated terms, and analyze similarities among them and their key characteristics in an interactive tool.
This tutorial is based on a proof-of-concept example given in Gramm et al. 2020. We are going to analyze similarities among 95 genes based on their associated biomedical terms in the literature, and compare their pre-existing disorder categories to their grouping based on the literature.
The workflow combines 3 main steps, starting with the retrieval of PubMed data for each of the genes. We then use the PubMed data from each gene to extract related scientific terms that are all combined in one large binary matrix. Finally, we explore the generated data in an interactive tool that performs different unsupervised machine-learning algorithms to analyze the similarities/ the grouping among the genes based on their extracted terms from the literature.
AgendaIn this tutorial, we will cover:
Input data
The input data is a simple table with the genes we want to analyze as well as their pre-existing grouping (the grouping is required later on to compare it to our text-based gene grouping). In order for the tools to recognize the column with the biomedical entities of interest, our 95 genes, the column name should start with “ID_”, and for the grouping variable with “GROUPING_”.
Hands-on: Data upload
Create a new history for this tutorial
Click the new-history icon at the top of the history panel.
If the new-history is missing:
- Click on the galaxy-gear icon (History options) on the top of the history panel
- Select the option Create New from the menu
Import the input file from Zenodo
https://zenodo.org/api/files/b7b2b1d8-bb18-423d-9fe4-3bce858265ac/clingen_data
- Copy the link location
Open the Galaxy Upload Manager (galaxy-upload on the top-right of the tool panel)
- Select Paste/Fetch Data
Paste the link into the text field
Press Start
- Close the window
Retrieval of PubMed data
In the first step we collect PubMed data for each of the genes. The genes are used as search queries to download a defined number of PMIDs, here up to 500, from PubMed. The PMIDs are saved in additional columns of our input data.
To speed up the the download of PubMed data users can obtain an API key from the settings page of their NCBI account (to create an account, visit http://www.ncbi.nlm.nih.gov/account/) and add it to the Galaxy user-preferences (User → Preferences → Manage Information).
Hands-on: Step 1: PubMed query tool
- Run PubMed query Tool: toolshed.g2.bx.psu.edu/repos/iuc/pubmed_by_queries/pubmed_by_queries/0.0.2 with the following parameters:
- param-file “Input file with query terms”: Input dataset
- “Number of PMIDs (or abstracts) to save per ID”:
500
CommentThe tool is also able to save the abstracts as text instead of their PMIDs. This feature is used for another type of analysis (see Gramm et al. 2020), or can be used if the user wants to use the tool independent from a workflow to retrieve many abstract texts at once. For the next step of our example in this tutorial, only PMIDs are required.
Extraction of biomedical terms from PubMed abstracts
Next, we extract the 100 most frequent ‘Disease’ and ‘Gene’ terms (PubTator annotations) from the PubMed data. All genes with their 100 associated terms are then combined in one large binary matrix. Each row represents a gene and each column one of the extracted terms. This matrix is later used to find similar genes, i.e. genes that have many common terms associated with them.
Hands-on: Extraction of PubTator annotations
- Run PMIDs to PubTator Tool: toolshed.g2.bx.psu.edu/repos/iuc/pmids_to_pubtator_matrix/pmids_to_pubtator_matrix/0.0.2 with the following parameters:
- param-file “Input file with PMID IDs”: output of PubMed query tool
- “categories”:
Genes Diseases
- “Number of most frequent terms/IDs to extract.”:
100
Comment: PubTatorPubTator annotates terms of the following categories: Gene, Disease, Mutation, Species and Chemical. In this example we chose to only extract gene and disease terms but you can also select other categories if you are interested in those.
Exploration of data in interactive tool
After generating the large binary matrix, we can explore the similarities/ the grouping among the genes in the interactive SimText tool. The following features are generated:
- Word clouds for each gene
- Dimension reduction and hierarchical clustering of the binary matrix
- Calculation of the adjusted rand index (similarity between text-based grouping and the pre-existing disorder categories)
- Table with terms and their frequency among the genes
Hands-on: Explore data interactively
- Run interactive_tool_simtext_app Tool: interactive_tool_simtext_app with the following parameters:
- param-file “Input file”: initial input file with genes and pre-existing grouping
- param-file “Matrix file”: output of PMIDs to PubTator tool
Open interactive tool
- Go to User > Active InteractiveTools
- Wait for the SimText app to be running (Job Info)
- Click on SimText app
Conclusion
Key points
The SimText toolset allows large-scale literature analysis of a set of biomedical entities such as genes or diseases
The similarities among the biomedical entities can be explored interactively
The litertaure based grouping can be compared to an existing grouping to discover similarities/ relationships hidden in the literature
Frequently Asked Questions
Have questions about this tutorial? Check out the tutorial FAQ page or the FAQ page for the Statistics and machine learning topic to see if your question is listed there. If not, please ask your question on the GTN Gitter Channel or the Galaxy Help ForumReferences
- Gramm, M., E. Perez-Palma, S. Schumacher-Bass, J. Dalton, C. Leu et al., 2020 SimText: A text mining framework for interactive analysis and visualization of similarities among biomedical entities. BioRxiv. 10.1101/2020.07.06.190629
Feedback
Did you use this material as an instructor? Feel free to give us feedback on how it went.
Did you use this material as a learner or student? Click the form below to leave feedback.
Citing this Tutorial
- Marie Gramm, Dennis Lal group, Daniel Blankenberg, 2022 Text-mining with the SimText toolset (Galaxy Training Materials). https://training.galaxyproject.org/training-material/topics/statistics/tutorials/text-mining_simtext/tutorial.html Online; accessed TODAY
- Batut et al., 2018 Community-Driven Data Analysis Training for Biology Cell Systems 10.1016/j.cels.2018.05.012
Congratulations on successfully completing this tutorial!@misc{statistics-text-mining_simtext, author = "Marie Gramm and Dennis Lal group and Daniel Blankenberg", title = "Text-mining with the SimText toolset (Galaxy Training Materials)", year = "2022", month = "10", day = "18" url = "\url{https://training.galaxyproject.org/training-material/topics/statistics/tutorials/text-mining_simtext/tutorial.html}", note = "[Online; accessed TODAY]" } @article{Batut_2018, doi = {10.1016/j.cels.2018.05.012}, url = {https://doi.org/10.1016%2Fj.cels.2018.05.012}, year = 2018, month = {jun}, publisher = {Elsevier {BV}}, volume = {6}, number = {6}, pages = {752--758.e1}, author = {B{\'{e}}r{\'{e}}nice Batut and Saskia Hiltemann and Andrea Bagnacani and Dannon Baker and Vivek Bhardwaj and Clemens Blank and Anthony Bretaudeau and Loraine Brillet-Gu{\'{e}}guen and Martin {\v{C}}ech and John Chilton and Dave Clements and Olivia Doppelt-Azeroual and Anika Erxleben and Mallory Ann Freeberg and Simon Gladman and Youri Hoogstrate and Hans-Rudolf Hotz and Torsten Houwaart and Pratik Jagtap and Delphine Larivi{\`{e}}re and Gildas Le Corguill{\'{e}} and Thomas Manke and Fabien Mareuil and Fidel Ram{\'{\i}}rez and Devon Ryan and Florian Christoph Sigloch and Nicola Soranzo and Joachim Wolff and Pavankumar Videm and Markus Wolfien and Aisanjiang Wubuli and Dilmurat Yusuf and James Taylor and Rolf Backofen and Anton Nekrutenko and Björn Grüning}, title = {Community-Driven Data Analysis Training for Biology}, journal = {Cell Systems} }