Deep Reinforcement Learning
Policy optimization, reward design, uncertainty-aware exploration and reliable closed-loop decision making.
Open to postdoctoral research opportunities & collaborations
Uddin Md.
Uddin Md.
Borhan
Ph.D. Candidate in Computer Science and Technology at Shenzhen University
I work on reliable policy transfer for safety-critical embodied autonomy, with a focus on deep reinforcement learning, Sim2Real/Sim2Sim transfer, uncertainty-aware control, UAVs, autonomous driving, robotic manipulation, and humanoid robotics.
Profile
Research that moves policies from simulation toward deployment.
My academic work connects policy learning, domain shift, safety, reliability and deployment-oriented evaluation across embodied autonomous systems.
9Published papers
13Manuscripts under review
4,500+Learners trained across programs
2026CVPR publication (First-author)
I am pursuing a Ph.D. in Computer Science and Technology at Shenzhen University. My core interests are Artificial Intelligence, Deep Reinforcement Learning and Simulation-to-Reality policy transfer for safety-critical embodied autonomy.
My work spans UAV autonomy, end-to-end autonomous driving, robotic manipulation and humanoid robotics, with emphasis on robust policy learning, uncertainty and risk, closed-loop evaluation, runtime verification and deployment-aware system design.
Alongside research, I have extensive experience in teaching, technical training, curriculum development, mentoring and coordination, including professional instruction across hundreds of training batches.
Deep Reinforcement Learning
Sim2Real / Sim2Sim
Embodied AI
UAV Autonomy
Autonomous Driving
Humanoid Robotics
ROS / ROS 2
Isaac Sim / Isaac Lab
CARLA
Research themes
Reliable autonomy across domains and embodiments.
A research portfolio centered on learning, transfer and assurance for autonomous systems that must operate under domain shift and safety constraints.
Sim2Real & Sim2Sim Transfer
Transfer interfaces and adaptation strategies that diagnose, reduce and control the gap between source and target domains.
Safety-Critical Embodied AI
Architectures that separate learned proposals from execution authority through risk-aware verification and control safeguards.
UAV Autonomy
GPS-denied inspection, robust speed control, visual localization degradation and emergency landing for autonomous aerial systems.
Autonomous Driving
Ego-relational representations, uncertainty-informed control, safety-aware transfer and end-to-end driving under distribution shift.
Humanoid & Robotic Manipulation
Object-centric policy transfer, action realization, deployment interfaces and cross-embodiment evaluation for physical robotic systems.
Scholarship
Publications & manuscripts.
Publication metadata is organized so it can be maintained from a single file (data.js).
News
Recent milestones & updates.
News cards are deliberately modular: replace the placeholder images and edit the entries in data.js as new milestones arrive.
Experience
Research, teaching & professional training.
A career path that combines academic research with long-form teaching and technical training experience.
Academic & professional experience
Graduate Teaching Assistant · Shenzhen University
Teaching support, coursework guidance, programming, technical problem solving, academic mentoring and research-oriented learning.
Training Manager & Senior Instructor · New Horizons
Managed technical-training programs, curriculum development, instructional planning, trainer coordination, evaluation and quality assurance; delivered and coordinated training for 300+ batches and 4,500+ learners.
Assistant Coordinator, Training & Development · Skill Jobs
Coordinated organization-wide training programs and training-needs analysis; contributed to a 20% revenue increase within six months.
Applications Instructor · New Horizons
Delivered programming, application-development, database and productivity-technology training while monitoring learner progress and course quality.
Education
- Ph.D. Candidate, Computer Science and Technology
Shenzhen University · Sep 2022 – Present · Expected Dec 2026 - M.Sc., Computer Science and Engineering
United International University · completed 2022 - B.Sc., Computer Science and Engineering
Daffodil International University · 2017
Academic exchange
- University of Toronto
English for Academic Communication · 2023 - National Youth Services Council, Sri Lanka
5th Bangladesh and Sri Lanka Youth Exchange Program · 2017 - Sias University, China
Chinese Language and Culture · 2016–2017 - University Malaysia Perlis
Asian Summer Program · 2014
Recognition
Awards, leadership & service.
Selected academic, volunteer, professional and leadership distinctions from the current CV.
Selected awards & honors
- Volunteer Award · Shenzhen Government · 2025
- Best International Volunteer · Nanshan District International Volunteer Services · 2024
- Shenzhen Universiade International Scholarship · 2023 & 2024
- Best Conference Paper Finalist · IEEE ICARM 2023
- Best Trainer Award · New Horizons Worldwide International Conference · 2022
- Best Paper Award · ICSECS-ICOCSIM · 2021
- Best Innovative Trainer · New Horizons Bangladesh · 2021
Leadership, membership & service
- Team Leader, SZU-PIONEER · 2026 Global Humanoid Robot Challenge
- Graduate Student Member · IEEE, Region 10 / Guangzhou Section
- Member · Institution of Engineers, Bangladesh (IEB)
- Director · YES Entrepreneur Bangladesh Limited
- Former Rover Mate · Air Region, Bangladesh Scouts
- Volunteer · Youth Against Hunger Bangladesh, Mastul, Asian Network of Youth Volunteers Society
Technical profile
Tools, teaching & training expertise.
A practical stack spanning autonomous systems research, software development and technical instruction.
Programming
C++, Java SE & EE, Python; data structures and algorithmic problem solving.
AI & ML
Deep reinforcement learning, machine learning, neural networks, NLP and policy optimization.
Robotics Toolchains
ROS / ROS 2, NVIDIA Isaac Sim / Isaac Lab, CARLA, Flightmare, Gazebo and Unity.
Web & APIs
HTML, CSS, JavaScript, PHP, Laravel, Spring Boot, Django and REST APIs.
Data & Databases
SQL, MySQL, Microsoft Access, data analysis and experiment reporting workflows.
Training & Project Delivery
Microsoft Project, curriculum development, technical training, mentoring and program coordination.