AIP-210 Practice Exam Questions with Answers CertNexus Certified Artificial Intelligence Practitioner (CAIP) Certification

Skip-gram and TF-IDF are both text vectorization methods that convert text into numerical feature vectors. Skip-gram is a prediction-based word embedding method that learns vector representations of words from their contexts in a large corpus of text. TF-IDF is a frequency-based word weighting method that assigns scores to words based on their importance in a document and in a corpus of documents. References: Text Vectorization and Word Embedding | Guide to Master NLP (Part 5), What Is Text Vectorization? Everything You Need to Know - deepset

Encoding is a technique that transforms categorical data into numerical features that can be used by machine learning models. Categorical data are data that have a finite number of possible values or categories, such as gender, color, or country. Encoding can help convert categorical data into a format that is suitable and understandable for machine learning models. Some of the encoding methods that can be used to transform categorical data into numerical features are:

Mean Encoder: Mean encoder is a method that replaces each category with the mean value of the target variable for that category. Mean encoder can capture the relationship between the category and the target variable, but it may cause overfitting or multicollinearity problems.

One-Hot Encoder: One-hot encoder is a method that creates a binary vector for each category, where only one element has a value of 1 (the hot bit) and the rest have a value of 0. One-hot encoder can create distinct and orthogonal vectors for each category, but it may increase the dimensionality and sparsity of the data.

Anomaly detection is an unsupervised learning technique that identifies outliers or abnormal patterns in data, which can be useful for fraud detection. Anomaly detection algorithms can learn the normal behavior of transactions and flag the ones that deviate significantly from the norm, indicating possible fraud.

An incident database is a database that is designed to better anticipate and avoid risks of AI systems causing safety, fairness, or other ethical problems. An incident database collects and stores information about incidents or events where AI systems have caused or contributed to negative outcomes or harms, such as accidents, errors, biases, discriminations, or violations. An incident database can help identify patterns, trends, causes, impacts, and solutions for AI-related incidents, as well as provide guidance and best practices for preventing or mitigating future incidents.

Logit-transformation is a common way to transform proportion data into a continuous variable that can be used for linear regression. However, one concern with this approach is that noisy data could become more influential in your model. This is because logit-transformation tends to amplify the values close to 0 and 1, which are also the values that are likely to be affected by measurement errors or outliers. This could distort the relationship between the dependent and independent variables and bias the regression coefficients. References: [Logit Transformation | Real Statistics Using Excel], [Logit transformation for proportions - Cross Validated]

Word embedding is a task in natural language processing (NLP) where words are converted into numerical vectors that represent their meaning, usage, or context. Word embedding can help reduce the dimensionality and sparsity of text data, as well as enable various operations and comparisons among words based on their vector representations. Some of the common methods for word embedding are:

One-hot encoding: One-hot encoding is a method that assigns a unique binary vector to each word in a vocabulary. The vector has only one element with a value of 1 (the hot bit) and the rest with a value of 0. One-hot encoding can create distinct and orthogonal vectors for each word, but it does not capture any semantic or syntactic information about words.

Word2vec: Word2vec is a method that learns a dense and continuous vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, such as synonyms, antonyms, analogies, or associations.

GloVe: GloVe (Global Vectors for Word Representation) is a method that combines the advantages of count-based methods (such as TF-IDF) and predictive methods (such as Word2vec) to create word vectors. GloVe can leverage both global and local information from a large corpus of text to capture the co-occurrence patterns and probabilities of words.

Hyperparameter optimization is the process of finding the optimal values for hyperparameters that control the learning process of a given algorithm. Hyperparameters are parameters that are not learned by the algorithm but are set by the user before training. Hyperparameters can affect the performance and behavior of the algorithm, such as its speed, accuracy, complexity, or generalization. Hyperparameter optimization can help improve the efficiency and effectiveness of the algorithm by tuning its hyperparameters to achieve the best results.

The Adversarial ML Threat Matrix is an open framework designed to help detect, respond to, and remediate threats in ML systems. The Adversarial ML Threat Matrix is inspired by the MITRE ATTandCK® Matrix1, which is a framework for describing cyberattacks across various stages of an attack lifecycle. The Adversarial ML Threat Matrix adapts this framework to address specific threats and vulnerabilities in ML systems, such as data poisoning, model stealing, model evasion, or model inversion2. The Adversarial ML Threat Matrix provides a structured way to organize and classify adversarial techniques, tactics, procedures, examples, and mitigations for ML systems2.

Underfitting is a problem that occurs when a model learns too little from the training data and fails to capture the underlying complexity or structure of the data. Underfitting can result from using insufficient or irrelevant features, a low complexity of the model, or a lack of training data. Underfitting can reduce the accuracy and generalization of the model, as it may produce oversimplified or inaccurate predictions. Some of the ways to fix underfitting are:

Add features to training data: Adding more features or variables to the training data can help increase the information and diversity of the data, which can help the model learn more complex patterns and relationships.

Increase the complexity of the model: Increasing the complexity of the model can help increase its expressive power and flexibility, which can help it fit better to the data. For example, adding more layers or nodes to a neural network can increase its complexity.

Train the model for more epochs: Training the model for more epochs can help increase its learning ability and convergence, which can help it optimize its parameters and reduce its error.

Getting more training data will not work to fix underfitting, as it will not change the complexity or structure of the data or the model. Getting more training data may help with overfitting, which is when a model learns too much from the training data and fails to generalize well to new or unseen data.

An L1 norm is a measure of distance or magnitude that is defined as the sum of the absolute values of the components of a vector. For example, if x and y are two components of a vector, then the L1 norm of that vector is |x| + |y|. The L1 norm is also known as the Manhattan distance or the taxicab distance, as it represents the shortest path between two points in a grid-like city.

Neural network models are suitable for classification problems with a large number of features, because they can learn complex and non-linear patterns from high-dimensional data. They can also handle image data, which is likely to be the input for the human face detection problem. Neural networks can also be trained using transfer learning, which can leverage pre-trained models on similar tasks and improve the accuracy and efficiency of the model. References: [Neural network - Wikipedia], [Transfer Learning - Machine Learning’s Next Frontier]

R-squared is a statistical measure that indicates how well a regression model fits the data. R-squared is calculated by dividing the explained variance by the total variance. The explained variance is the amount of variation in the dependent variable that can be attributed to the independent variables. The total variance is the amount of variation in the dependent variable that can be observed in the data. R-squared ranges from 0 to 1, where 0 means no fit and 1 means perfect fit.

Security measures can be applied in different ML workflow stages to defend them against malicious activities, such as data theft, model tampering, or adversarial attacks. Some of the security measures are:

Launch ML Instances In a virtual private cloud (VPC): A VPC is a logically isolated section of a cloud provider’s network that allows users to launch and control their own resources. By launching ML instances in a VPC, users can enhance the security and privacy of their data and models, as well as restrict the access and traffic to and from the instances.

Use data encryption: Data encryption is the process of transforming data into an unreadable format using a secret key or algorithm. Data encryption can protect the confidentiality, integrity, and availability of data at rest (stored in databases or files) or in transit (transferred over networks). Data encryption can prevent unauthorized access, modification, or leakage of sensitive data.

Use Secrets Manager to protect credentials: Secrets Manager is a service that helps users securely store, manage, and retrieve secrets, such as passwords, API keys, tokens, or certificates. Secrets Manager can help users protect their credentials from unauthorized access or exposure, as well as rotate them automatically to comply with security policies.

Semi-supervised learning is an approach that is best if a limited portion of your training data is labeled. Semi-supervised learning is a type of machine learning that uses both labeled and unlabeled data to train a model. Semi-supervised learning can leverage the large amount of unlabeled data that is easier and cheaper to obtain and use it to improve the model’s performance. Semi-supervised learning can use various techniques, such as self-training, co-training, or generative models, to incorporate unlabeled data into the learning process.

Personas are fictional characters that represent the potential users or customers of an ML system. Personas can help understand the needs, goals, preferences, and behaviors of the target audience, as well as design and evaluate the system from their perspective. Some of the techniques that are used to build personas in the ML development lifecycle are:

Population estimates: Population estimates are statistical methods that estimate the size, characteristics, and distribution of a population based on a sample or a census. Population estimates can help identify and quantify the potential market segments and user groups for an ML system, as well as their demographics, locations, and behaviors.

Population triage: Population triage is a process of prioritizing and selecting the most relevant and representative personas for an ML system based on some criteria or metrics. Population triage can help focus on the key user needs and scenarios, as well as avoid creating too many or too few personas.

Lasso regression is a type of linear regression that adds a regularization term to the loss function to reduce overfitting and improve generalization. Lasso regression uses an L1 norm as the regularization term, which is the sum of the absolute values of the coefficients. Lasso regression can shrink some of the coefficients to zero, which effectively eliminates some of the features from the model. Lasso regression is preferable over ridge regression when there are many features with no association with the dependent variable, as it can perform feature selection and reduce the complexity and noise of the model.

Data privacy is the right of individuals to control how their personal data is collected, used, shared, and protected. It also involves complying with relevant laws and regulations that govern the handling of personal data. Data privacy is especially important when extracting business intelligence from primary data captured from the public, as it may contain sensitive or confidential information that could harm the individuals if misused or breached .

Semi-supervised learning is a type of machine learning that uses both labeled and unlabeled data to train a model. Semi-supervised learning can be useful when:

Labeling data is challenging and expensive: Labeling data requires human intervention and domain expertise, which can be costly and time-consuming. Semi-supervised learning can leverage the large amount of unlabeled data that is easier and cheaper to obtain and use it to improve the model’s performance.

There is a large amount of unlabeled data to be used for predictions: Unlabeled data can provide additional information and diversity to the model, which can help it learn more complex patterns and generalize better to new data. Semi-supervised learning can use various techniques, such as self-training, co-training, or generative models, to incorporate unlabeled data into the learning process.

IBM Watson is an AI technology that can take a question in natural language and return a precise answer to the question. IBM Watson is a cognitive computing system that can understand natural language, generate hypotheses, and provide evidence-based answers. IBM Watson can be applied to various domains and industries, such as healthcare, education, finance, or law.

A support-vector machine (SVM) is a supervised learning algorithm that can be used for classification or regression problems. An SVM tries to find an optimal hyperplane that separates the data into different categories or classes. However, sometimes the data is not linearly separable, meaning there is no straight line or plane that can separate them. In such cases, a polynomial kernel can help improve the prediction of the SVM by transforming the data into a higher-dimensional space where it becomes linearly separable. A polynomial kernel is a function that computes the similarity between two data points using a polynomial function of their features.

Preexisting bias is a type of bias that originates from historical or social contexts, such as stereotypes, prejudices, or discriminations. Preexisting bias can affect the data or the algorithm used for machine learning, as well as the outcomes or decisions made by machine learning. Preexisting bias can cause unfair or harmful impacts on certain groups or individuals based on their attributes, such as gender, race, age, or disability3. In this case, the software that uses machine learning generates lower employability scores for women and predicts that women, especially with children, are less likely to get a high-paying job. This indicates that the software has preexisting bias against women, which may reflect the historical or social inequalities or expectations in the labor market.