Skip to content

Latest commit

 

History

History
13 lines (10 loc) · 513 Bytes

README.md

File metadata and controls

13 lines (10 loc) · 513 Bytes

GELU Kernel

Files:

  1. glu_python.py

    • Implements the GELU (Gaussian Error Linear Unit) activation function in Python.
    • Used for verifying the correctness of CUDA implementation and testing input/output behavior.
    • Supports input arrays of arbitrary dimensions.

  2. glu.cu

    • CUDA implementation of the GELU activation function for high-performance computation on GPUs.
    • Handles large-scale tensor operations with optimized memory allocation and parallelism.