PadhaikoAll subjects

Past exam question: 2081 Chaitra (Regular), Q7(iii)

Foundation of Data Science · 4 marks

Open in the Padhaiko app

Topic: The Five Cs & Future Trends

Question

Write brief notes on: (Any Three)

(iii) Generative AI

Solution

Definition and Paradigmatic Shift of Generative AI: Generative Artificial Intelligence (GenAI) refers to advanced deep learning models that generate realistic, novel content—including natural language text, synthetic tabular data, realistic imagery, audio, and executable computer code—by learning the underlying joint probability distribution of large unstructured training corpora.

This represents a major paradigm shift from traditional Discriminative AI:

Foundational Model Architectures: Generative AI relies on several transformative neural architectures:

  1. Transformer Architecture & Self-Attention: The engine behind modern Large Language Models (LLMs like GPT, LLaMA, Claude, Gemini). Self-attention mechanisms enable the model to capture long-range contextual dependencies across tokens simultaneously rather than sequentially.
  2. Diffusion Models: Learn to reconstruct high-fidelity data by reversing a progressive forward noising process (gradually destroying data with Gaussian noise, then training a neural network to denoise it step-by-step; powers tools like Stable Diffusion and Midjourney).
  3. Generative Adversarial Networks (GANs): Formulated as a two-player zero-sum game between a Generator network that creates synthetic candidates and a Discriminator network that attempts to distinguish real training samples from generated fakes.
  4. Variational Autoencoders (VAEs): Map high-dimensional inputs to a continuous, probabilistic latent space, allowing new instances to be synthesized by sampling latent coordinates.

Applications and Practical Challenges in Data Science:

Answer:

Generative AI comprises deep learning architectures (Transformers, Diffusion models, GANs, VAEs) that learn data distributions to generate novel text, images, code, and synthetic data, shifting machine learning from classification to synthesis. In data science, GenAI powers synthetic data generation, automated coding, and multimodal analysis, while presenting operational challenges around hallucinations, algorithmic bias, and computational costs.

All past exam questions for Foundation of Data Science