Hi I have some CUDA memory issue even though I am using multiple GPUs. I am calling coreference resolution API on long document (aorund 2000words). It seems that the memory is not paralleled. How can I solve this issue? (I am currently using the API as here https://demo.allennlp.org/coreference-resolution)
CUDA memory issue with allennlp coreference resolution API
73 Views Asked by Yijiang Dong At
1
There are 1 best solutions below
Related Questions in ALLENNLP
- Being unabe to transfer an allen.nlp.Elmo model and character_ids on the same device
- Unable to install jsonnet in Google Colab notebook: failed building wheel
- Want to do coreference resolution. Can't install neuralcoref, allennlp and required version of spacy
- AttributeError by Allen NLP with pre trained Hugging face model
- Allennlp 2.10.1 Predictor throws "Not implemented" and "KeyError" Errors
- Unable to install spacy 2.1.9 on google colab with python 3.10
- Google Colab upgraded python version to 3.10
- Why the training time of CRF module from allennlp is higher?
- InvalidVersion: Invalid version: '0.10.1,<0.11' in Colab when trying to "from allennlp.nn.util import sort_batch_by_length, masked_softmax"
- How can I make the openIE input file format
- How to convert a list of words into multiple sentences in python
- How to install jsonnet on conda
- Load custom package model to get model vocabulary in AllenNLP python interface
- Change tokenizer when loading Dependency Parsing model from AllenNLP
- CUDA memory issue with allennlp coreference resolution API
Related Questions in COREFERENCE-RESOLUTION
- ERROR: Could not build wheels for neuralcoref, which is required to install pyproject.toml-based projects
- Want to do coreference resolution. Can't install neuralcoref, allennlp and required version of spacy
- Performing Coreference Resolution on .mtx data file
- Unable to install NeuralCoref following SpaCy install
- Coreference resolution when there are no explicit references
- Stanford Corenlp MentionDetectionClassifier not found
- How to fine-tune spacy-experimental "en-coreference-web-trf" model on my own custom domain dataset
- SpaCy Coreferee: How to cleanly extract coreferenced text
- What is the best way to handle Coreference Resolution in NLP
- CUDA memory issue with allennlp coreference resolution API
- Allennlp Does not generate model.tar.gz after training
- Try to process multiple strings from pandas dataframe seperately from each other and create triples from it
- OOM issues with AllenNLP coreference resolution training and substituting models
- Replace bidirectional LSTM with GRU in coref?
- Reference resolution in python
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
The coref model uses a lot of memory. It does not automatically take advantage of multiple GPUs. The best thing you can do is reduce the maximum sequence length you send to the model until it fits.