ML Projects

Building Pytorch from Source (2025)

Built PyTorch from source on Windows 10 using Microsoft Visual Studio 2022 and CMake configuring the build for CUDA 12.4 support and optimizing GPU utilization for deep learning tasks

CUDA TCP Project (2025)

Repo Link

Click to view README.md

CUDA TCP Project Demo (Windows)

This project demonstrates how to simulate a CUDA-based computational workload over TCP/IP on a Windows platform. The server performs data processing using GPU and handles multiple client requests concurrently, enabling high-performance computations through CUDA.

Overview

This is a single-file project that combines both server and client functionality into one .cpp file, utilizing multithreading to concurrently handle multiple client requests. The server processes the commands sent by the client, performs CUDA-based operations (array addition, matrix multiplication), and sends the results back to the client.

Server: Handles multiple client connections, processes various commands (like array addition and matrix multiplication), and offloads the computational work to the GPU using CUDA.
Client: Sends commands to the server (like add, matmul, or exit), receives the results, and displays them.

The server communicates with clients over TCP/IP, and the server is designed to handle multiple requests at the same time by creating a new thread for each client.

Key Features

Multithreading: Each client connection is handled in a separate thread, allowing the server to process multiple requests concurrently without blocking.
CUDA Acceleration: Array addition and matrix multiplication operations are processed on the GPU using CUDA, leveraging parallel processing capabilities for improved performance.
Active Connection Tracking: The server tracks and displays the number of active client connections, ensuring proper management of client sessions.
Basic Command Handling: The server supports three commands: add (for array addition), matmul (for matrix multiplication), and exit (to close the connection).
Windows-Specific: Uses Windows Socket programming (winsock2) for network communication.

Requirements

To build and run this project, ensure you have the following installed:

CUDA Toolkit: Required to compile and run CUDA-based functions. This project uses CUDA 12.6 (latest version at the time).
Windows Operating System: This project is designed to run on Windows-based platforms.
Visual Studio (or other IDE for CUDA & C++): Visual Studio is commonly used for CUDA development, but any IDE or build environment that supports C++ and CUDA should work.

Dependencies

CUDA Toolkit: For GPU-accelerated operations such as array addition and matrix multiplication.
Winsock2: Windows-specific library for socket communication (built into Windows).

Commands

Command Prefix:

None: No prefix is required for the commands.

Command Suffixes:

add: Triggers the CUDA-based array addition operation.
matmul: Triggers the CUDA-based matrix multiplication operation.
exit: Terminates the client-server connection.

Example Client Interaction:

```sh Enter command (add, matmul, exit): add Response from server: Result: {11, 22, 33, 44, 55}

Enter command (add, matmul, exit): matmul Response from server: Result: 30 24 18 84 69 54 138 114 90