Can video calling look more realistic in the future? US-based research scientist agrees  

Our lives are incomplete without technology. From using a mobile phone to watching our favourite film, everything is driven by complex algorithms and systems. And these have been put in place to enable our ‘smart lives.’ A research scientist in the United States, Anjul Patney shares more about the new trends in AI, Deep Learning and Visual Perception. Read on, edited excerpts from his interview. 

Please tell us more about your educational background.

I had the privilege of attending Apeejay School, Pitampura for all of my schooling years, right from kindergarten to class 12. After completing that my Bachelors in Technology (Electrical Engineering) was at Indian Institute of Technology, Delhi.

I decided to pursue my passion for Electrical and Communication Engineering at the University of California, Davis. It was there, I completed my Masters and Ph.D. and further honed my skills in the field. Looking back, I feel grateful for the opportunities that I had and the experiences that shaped me into the engineer I am today.

Why did you choose science and research as your profession?

Since middle-school, I have been passionate about science, particularly Computer Science. I was drawn to Electrical and Computer Engineering because it aligned with my interests and offered a promising career. Additionally, I have always been a huge fan of video games, and I hoped to find a way to incorporate the same into my career. This led me to focus on Computer Graphics and the architecture of Graphics Processors (GPUs). So, I quickly realised that a Bachelor’s degree would not be enough to break into this field. Then, I opted for a Ph.D. and I thoroughly enjoyed conducting research. Thus far, it has been a rewarding journey.

Do tell us about your role at NVIDIA.

As a Principal Research Scientist at NVIDIA in Redmond, Washington, I am fortunate to have the opportunity to conduct scientific research in the fields of Visual Perception, Computer Graphics, Machine Learning, and Virtual/Augmented Reality (VR/AR). My recent work has contributed to advances in deep learning for real-time graphics including the co-development of DLSS, an AI-based gaming technology that has been adopted by millions of GPUs worldwide.

I have also been involved in the development of state-of-the-art metrics for image quality assessment, Foveated rendering for VR graphics and redirected walking in VR environments.

What is latest in AI, Deep Learning and Visual Perception?

The intersection of AI and Visual Perception is currently undergoing a major transformation. Some of the key technologies that are driving this change are Dall-E, Stable Diffusion and NERFs. It is producing truly remarkable results that will likely disrupt a wide range of industries.

My own work focuses on these technologies and I am particularly interested in how humans perceive images. In fact, recent advancements in technology have allowed us to accurately predict how the quality of visual content is perceived by an individual such as images, videos, and games. It’s an exciting time to be working in this field. I am eager to see how these technologies will continue to evolve.

What is in it for students?  

I think it is safe to assume that AI and related technologies will play a major role in almost all aspects of our lives. In the near future, it is possible that every pixel we see on a computer, phone or TV will be generated by advanced AI-based systems that can accurately predict how humans will consume the presented information.

Therefore, it is important for students to learn about these systems and how they can be used. In many ways, this is just as fundamental as basic math or coding. In the foreseeable future, it will be important for young learners to understand how these systems work and how they can be used to benefit their lives.

Any upcoming trends in the next 5 years?

I think we should get ready for an incredible revolution in visual media and experiences. Soon, not only movies and video games, but almost everything we do with our phones will be powered by futuristic AI solutions that are personalised, accessible, and incredibly accurate. These technologies will feel like they are straight out of a science fiction movie.

Just imagine, when you video call someone, they will no longer be confined to a screen but you will feel like they are physically present with you. Or with a quick camera capture, will be able to predict in seconds how a new dress will fit you. That’s just the tip of the iceberg as the possibilities are truly endless.

Your experience at Apeejay, Pitampura?

I am grateful for the education that I received at Apeejay. I was lucky to have been taught by an incredibly talented and supportive group of teachers including some who are still here today: Mrs. Vandana Arora, Mrs. Pooja Malhotra, Mrs. Mala Dayal, Mrs. Babita Kathuria and Mrs. Malini Sridhar.

I also had the good fortune to make many lifelong friends who were both intelligent and humble. It was during my time at Apeejay that I discovered my passion for Computer Science, Computer Graphics, and Science, and received the encouragement and support to pursue them. This institution clearly played a key role in shaping the direction of my career.

Your message for students?

Take advantage of your school years to explore as many different directions as possible. This is the time to try out new things, discover your passions and figure out what truly excites and motivates you. At the same time, it’s important to focus on the areas that can open up exciting career opportunities for you.

So, whether you’re interested in sports, public speaking, or science, if you can find something that combines your passions with the potential for success, I encourage you to pursue it with all your energy. I promise that it will be incredibly rewarding and fulfilling.