## Model Overview ### Description: VISTA-3D is a specialized interactive foundation model for 3D medical imaging. It excels in providing accurate and adaptable segmentation analysis across anatomies and modalities. Utilizing a multi-head architecture, VISTA-3D adapts to varying conditions and anatomical areas, helping guide users' annotation workflow. This model is for research purposes and not for clinical usage. * **Segment everything:** Enables whole body exploration, crucial for understanding complex diseases affecting multiple organs and for holistic treatment planning. * **Segment using class:** Provides detailed sectional views based on specific classes, essential for targeted disease analysis or organ mapping, such as tumor identification in critical organs. * **Segment point prompts:** Enhances segmentation precision through user-directed, click-based selection. This interactive approach accelerates the creation of accurate ground-truth data, essential in medical imaging analysis. ### Terms of use By using this model, you are agreeing to the [terms and conditions](https://docs.nvidia.com/ai-foundation-models-community-license.pdf) of the license. ### References(s): Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollár, Ross Girshick, 2023. High-resolution 3D abdominal segmentation with random patch network fusion. Segment Anything. arXiv:2304.02643 ### Model Architecture: **Architecture Type:** Transformer
**Network Architecture:** SAM-like ### Input: **Input Type(s):** Computed Tomography (CT) Image
**Input Format(s):** (Neuroimaging Informatics Technology Initiative) NIfTI
**Input Parameters:** Three-Dimensional (3D)
**Other Properties Related to Input:** Array of Class/Point Information ### Output: **Output Type(s):** Image
**Output Format:** NIfTI
**Output Parameters:** 3D
## Software Integration: **Runtime Engine(s):** MONAI Core v.1.3
**Supported Hardware Microarchitecture Compatibility:**
* Ampere
* Hopper
**[Preferred/Supported] Operating System(s):**
* Linux
## Inference: **Engine:** [Triton](https://developer.nvidia.com/triton-inference-server)
**Test Hardware:** A100, H100, L40
## Ethical Considerations: NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. For more detailed information on ethical considerations for this model, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards. Please report security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).

nvidia/vista-3d