Use Real ISTQB Achieve the CT-AI Dumps – 100% Exam Passing Guarantee [Q38-Q62]

4.5/5 - (2 votes)

Use Real ISTQB Achieve the CT-AI Dumps – 100% Exam Passing Guarantee

Verified CT-AI Q&As – Pass Guarantee CT-AI Exam Dumps

ISTQB CT-AI Exam Syllabus Topics:

Topic	Details
Topic 1	Test Environments for AI-Based Systems: This section is about factors that differentiate the test environments for AI-based
Topic 2	Machine Learning ML: This section includes the classification and regression as part of supervised learning, explaining the factors involved in the selection of ML algorithms, and demonstrating underfitting and overfitting.
Topic 3	ML: Data: This section of the exam covers explaining the activities and challenges related to data preparation. It also covers how to test datasets create an ML model and recognize how poor data quality can cause problems with the resultant ML model.
Topic 4	Using AI for Testing: In this section, the exam topics cover categorizing the AI technologies used in software testing.
Topic 5	systems from those required for conventional systems.
Topic 6	Methods and Techniques for the Testing of AI-Based Systems: In this section, the focus is on explaining how the testing of ML systems can help prevent adversarial attacks and data poisoning.
Topic 7	Testing AI-Based Systems Overview: In this section, focus is given to how system specifications for AI-based systems can create challenges in testing and explain automation bias and how this affects testing.

NEW QUESTION 38
“Splendid Healthcare” has started developing a cancer detection system based on ML. The type of cancer they plan on detecting has 2% prevalence rate in the population of a particular geography. It is required that the model performs well for both normal and cancer patients.
Which ONE of the following combinations requires MAXIMIZATION?
SELECT ONE OPTION

Maximize precision and accuracy

Maximize accuracy and recall

Maximize recall and precision

Maximize specificity number of classes

* Prevalence Rate and Model Performance:
* The cancer detection system being developed by “Splendid Healthcare” needs to account for the fact that the type of cancer has a 2% prevalence rate in the population. This indicates that the dataset is highly imbalanced with far fewer positive (cancer) cases compared to negative (normal) cases.
* Importance of Recall:
* Recall, also known as sensitivity or true positive rate, measures the proportion of actual positive cases that are correctly identified by the model. In medical diagnosis, especially cancer detection, recall is critical because missing a positive case (false negative) could have severe consequences for the patient. Therefore, maximizing recall ensures that most, if not all, cancer cases are detected.
* Importance of Precision:
* Precision measures the proportion of predicted positive cases that are actually positive. High precision reduces the number of false positives, meaning fewer people will be incorrectly diagnosed with cancer. This is also important to avoid unnecessary anxiety and further invasive testing for those who do not have the disease.
* Balancing Recall and Precision:
* In scenarios where both false negatives and false positives have significant consequences, it is crucial to balance recall and precision. This balance ensures that the model is not only good at detecting positive cases but also accurate in its predictions, reducing both types of errors.
* Accuracy and Specificity:
* While accuracy (the proportion of total correct predictions) is important, it can be misleading in imbalanced datasets. In this case, high accuracy could simply result from the model predicting the majority class (normal) correctly. Specificity (true negative rate) is also important, but for a cancer detection system, recall and precision take precedence to ensure positive cases are correctly and accurately identified.
* Conclusion:
* Therefore, for a cancer detection system with a low prevalence rate, maximizing both recall and precision is crucial to ensure effective and accurate detection of cancer cases.
This explanation aligns with the principles outlined in the ISTQB CT-AI Syllabus, particularly sections on performance metrics for ML models and handling imbalanced datasets (Chapter 5: ML Functional Performance Metrics).

NEW QUESTION 39
Which ONE of the following describes a situation of back-to-back testing the LEAST?
SELECT ONE OPTION

Comparison of the results of a current neural network model ML model implemented in platform A (for example Pytorch) with a similar neural network model ML model implemented in platform B (for example Tensorflow), for the same data.

Comparison of the results of a home-grown neural network model ML model with results in a neural network model implemented in a standard implementation (for example Pytorch) for same data

Comparison of the results of a neural network ML model with a current decision tree ML model for the same data.

Comparison of the results of the current neural network ML model on the current data set with a slightly modified data set.

Back-to-back testing is a method where the same set of tests are run on multiple implementations of the system to compare their outputs. This type of testing is typically used to ensure consistency and correctness by comparing the outputs of different implementations under identical conditions. Let’s analyze the options given:
A . Comparison of the results of a current neural network model ML model implemented in platform A (for example Pytorch) with a similar neural network model ML model implemented in platform B (for example Tensorflow), for the same data.
This option describes a scenario where two different implementations of the same type of model are being compared using the same dataset. This is a typical back-to-back testing situation.
B . Comparison of the results of a home-grown neural network model ML model with results in a neural network model implemented in a standard implementation (for example Pytorch) for the same data.
This option involves comparing a custom implementation with a standard implementation, which is also a typical back-to-back testing scenario to validate the custom model against a known benchmark.
C . Comparison of the results of a neural network ML model with a current decision tree ML model for the same data.
This option involves comparing two different types of models (a neural network and a decision tree). This is not a typical scenario for back-to-back testing because the models are inherently different and would not be expected to produce identical results even on the same data.
D . Comparison of the results of the current neural network ML model on the current data set with a slightly modified data set.
This option involves comparing the outputs of the same model on slightly different datasets. This could be seen as a form of robustness testing or sensitivity analysis, but not typical back-to-back testing as it doesn’t involve comparing multiple implementations.
Based on this analysis, option C is the one that describes a situation of back-to-back testing the least because it compares two fundamentally different models, which is not the intent of back-to-back testing.

NEW QUESTION 40
A motorcycle engine repair shop owner wants to detect a leaking exhaust valve and fix it before it fails and causes catastrophic damage to the engine. The shop developed and trained a predictive model with historical data files from known healthy engines and ones which experienced a catastrophic failure due to exhaust valve failure. The shop evaluated 200 engines using this model and then disassembled the engines to assess the true state of the valves, recording the results in the confusion matrix below.

What is the precision of this predictive model?

90.0%

94.5%

98.9%

94.2%

NEW QUESTION 41
Consider a machine learning model where the model is attempting to predict if a patient is at risk for stroke.
The model collects information on each patient regarding their blood pressure, red blood cell count, smoking status, history of heart disease, cholesterol level, and demographics. Then, using a decision tree the model predicts whether or not the associated patient is likely to have a stroke in the near future. Once the model is created using a training dataset, it is used to predict a stroke in 80 additional patients. The table below shows a confusion matrix on whether or not the model made a correct or incorrect prediction.

The testers have calculated what they believe to be an appropriate functional performance metric for the model. They calculated a value of 0.6667.
Which metric did the testers calculate?

F1-score

Precision

Recall

Accuracy

NEW QUESTION 42
You have been developing test automation for an e-commerce system. One of the problems you are seeing is that object recognition in the GUI is having frequent failures. You have determined this is because the developers are changing the identifiers when they make code updates.
How could AI help make the automation more reliable?

It could modify the automation code to ignore unrecognizable objects to avoid failures.

It could generate a model that will anticipate developer changes and pre-alter the test automation code accordingly.

It could dynamically name the objects, altering the source code, so the object names will match the object names used in the automation.

It could identify the objects multiple ways and then determine the most commonly used and stable identification for each object.

NEW QUESTION 43
Which of the following statements regarding experience-based testing for AI-based systems is correct?
Choose ONE option (1 out of 4)

Intuitive test case design for AI-based systems involves interactive, hypothesis-driven examination of data for correlations or developmental trends.

In checklist-based testing of AI-based systems, the existing test cases are dynamically adapted, for example based on metamorphic testing.

Exploratory testing is often used for AI-based systems because there are often insufficient specifications or problems with the test oracle for AI-based systems.

Tour refers to intuitive test case design for AI-based systems based on multiple, sequential test cases using systematically biased training data.

NEW QUESTION 44
In a conference on artificial intelligence (Al), a speaker made the statement, “The current implementation of Al using models which do NOT change by themselves is NOT true Al*. Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why?
SELECT ONE OPTION

This statement is incorrect. Current Al is true Al and there is no reason to believe that this fact will change over time.

This statement is correct. In general, what is considered Al today may change over time.

This statement is incorrect. What is considered Al today will continue to be Al even as technology evolves and changes.

This statement is correct. In general, today the term Al is utilized incorrectly.

NEW QUESTION 45
Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase?
SELECT ONE OPTION

Testing the accuracy of the classification model.

Testing the API of the service powered by the ML model.

Testing the speed of the training of the model.

Testing the speed of the prediction by the model.

NEW QUESTION 46
A neural network has been designed and created to assist day-traders improve efficiency when buying and selling commodities in a rapidly changing market. Suppose the test team executes a test on the neural network where each neuron is examined. For this network the shortest path indicates a buy, and it will only occur when the one-day predicted value of the commodity is greater than the spot price by 0.75%. The neurons are stimulated by entering commodity prices and testers verify that they activate only when the future value exceeds the spot price by at least 0.75%.
Which of the following statements BEST explains the type of coverage being tested on the neural network?

Threshold coverage

Neuron coverage

Sign-change coverage

Value-change coverage

Threshold coverageis a specific type of coverage measure used in neural network testing. It ensures that each neuron in the network achieves an activation value greater than a specified threshold. This is particularly relevant to the scenario described, where testers verify that neurons activate only when the future value of the commodity exceeds the spot price by at least0.75%.
* Threshold-based activation:The test case in the question isexplicitly verifying whether neurons activate only when a certain threshold (0.75%) is exceeded.This aligns perfectly with the definition ofthreshold coverage.
* Common in Neural Network Testing:Threshold coverage is used to measurewhether each neuron in a neural network reaches a specified activation value, ensuring that the neural network behaves as expected when exposed to different test inputs.
* Precedent in Research:TheDeepXplore frameworkused a threshold of0.75%to identify incorrect behaviors in neural networks, making this coverage criterion well-documented in AI testing research.
* (B) Neuron Coverage#
* Neuron coverageonly checks whether a neuron activates (non-zero value)at some point during testing. It does not consider specific activation thresholds, making it less precise for this scenario.
* (C) Sign-Change Coverage#
* This coverage measures whether each neuron exhibitsboth positive and negative activation values, which isnot relevant to the given scenario(where activation only matters when exceeding a specific threshold).
* (D) Value-Change Coverage#
* This coverage requires each neuron to producetwo activation values that differ by a chosen threshold, but the question focuses onwhether activation occurs beyond a fixed threshold, not changes in activation values.
* Threshold coverage ensures that neurons exceed a given activation threshold”Full threshold coverage requires that each neuron in the neural network achieves an activation value greater than a specified threshold. The researchers who created the DeepXplore framework suggested neuron coverage should be measured based on an activation value exceeding a threshold, changing based on the situation.” Why is Threshold Coverage Correct?Why Other Options are Incorrect?References from ISTQB Certified Tester AI Testing Study GuideThus,option A is the correct answer, asthreshold coverage ensures the neural network’s activation is correctly evaluated based on the required condition (0.75%).

NEW QUESTION 47
“AllerEgo” is a product that uses sell-learning to predict the behavior of a pilot under combat situation for a variety of terrains and enemy aircraft formations. Post training the model was exposed to the real- world data and the model was found to be behaving poorly. A lot of data quality tests had been performed on the data to bring it into a shape fit for training and testing.
Which ONE of the following options is least likely to describes the possible reason for the fall in the performance, especially when considering the self-learning nature of the Al system?
SELECT ONE OPTION
The difficulty of defining criteria for improvement before the model can be accepted.
The fast pace of change did not allow sufficient time for testing.
The unknown nature and insufficient specification of the operating environment might have caused the poor performance.
There was an algorithmic bias in the Al system.

The difficulty of defining criteria for improvement before the model can be accepted.
Defining criteria for improvement is a challenge in the acceptance of AI models, but it is not directly related to the performance drop in real-world scenarios. It relates more to the evaluation and deployment phase rather than affecting the model’s real-time performance post-deployment.

The fast pace of change did not allow sufficient time for testing.
This can significantly affect the model’s performance. If the system is self-learning, it needs to adapt quickly, and insufficient testing time can lead to incomplete learning and poor performance.

The unknown nature and insufficient specification of the operating environment might have caused the poor performance.
This is highly likely to affect performance. Self-learning AI systems require detailed specifications of the operating environment to adapt and learn effectively. If the environment is insufficiently specified, the model may fail to perform accurately in real-world scenarios.

There was an algorithmic bias in the AI system.Algorithmic bias can significantly impact the performance of AI systems. If the model has biases, it will not perform well across different scenarios and data distributions.

NEW QUESTION 48
Which of the following is a problem with AI-generated test cases that are generated from the requirements?

They are slow and will usually not be able to execute in the time allowed

They make debugging more complicated because the number of steps is usually high in order to induce the target failure

They are defect-prone because they are unable to detect nuances in the requirements

They are usually missing the expected results, so verification is difficult or must resort to only detecting significant failures

NEW QUESTION 49
Which of the following is an example of an input change where it would be expected that the AI system should be able to adapt?

It has been trained to recognize cats and is given an image of a dog

It has been trained to recognize human faces at a particular resolution and it is given a human face image captured with a higher resolution

It has been trained to analyze mathematical models and is given a set of landscape pictures to classify

It has been trained to analyze customer buying trend data and is given information on supplier cost data

NEW QUESTION 50
Which ONE of the following statements correctly describes the importance of flexibility for Al systems?
SELECT ONE OPTION

Al systems are inherently flexible.

Al systems require changing of operational environments; therefore, flexibility is required.

Flexible Al systems allow for easier modification of the system as a whole.

Self-learning systems are expected to deal with new situations without explicitly having to program for it.

NEW QUESTION 51
A wildlife conservation group would like to use a neural network to classify images of different animals. The algorithm is going to be used on a social media platform to automatically pick out pictures of the chosen animal of the month. This month’s animal is set to be a wolf. The test teamhas already observed that the algorithm could classify a picture of a dog as being a wolf because of the similar characteristics between dogs and wolves. To handle such instances, the team is planning to train the model with additional images of wolves and dogs so that the model is able to better differentiate between the two.
What test method should you use to verify that the model has improved after the additional training?

Metamorphic testing because the application domain is not clearly understood at this point.

Adversarial testing to verify that no incorrect images have been used in the training.

Pairwise testing using combinatorics to look at a long list of photo parameters.

Back-to-back testing using the version of the model before training and the new version of the model after being trained with additional images.

NEW QUESTION 52
How can a tester check the system for bias as part of a review of data sources, acquisition, and preprocessing?
Choose ONE option (1 out of 4)

During the review, it can uncover algorithmic bias by analysing the procedures used to obtain the training data.

During the review of the preprocessing, the auditor can uncover whether the data has been influenced in a way that could lead to sample distortions.

It may use the LIME method as part of its data collection review to detect inappropriate bias.

As part of the review of preprocessing, it can reveal whether the data has been influenced in a way that could lead to algorithmic bias.

NEW QUESTION 53
A system was developed for screening the X-rays of patients for potential malignancy detection (skin cancer).
A workflow system has been developed to screen multiple cancers by using several individually trained ML models chained together in the workflow.
Testing the pipeline could involve multiple kind of tests (I – III):
I.Pairwise testing of combinations
II.Testing each individual model for accuracy
III.A/B testing of different sequences of models
Which ONE of the following options contains the kinds of tests that would be MOST APPROPRIATE to include in the strategy for optimal detection?
SELECT ONE OPTION

Only III

I and II

I and III

Only II

NEW QUESTION 54
Data used for an object detection ML system was found to have been labelled incorrectly in many cases.
Which ONE of the following options is most likely the reason for this problem?
SELECT ONE OPTION

Security issues

Accuracy issues

Privacy issues

Bias issues

NEW QUESTION 55
Which machine learning approach is most suitable for predicting customer purchase probability?
Choose ONE option (1 out of 4)

Supervised learning (regression)

Supervised learning (classification)

Unsupervised learning

Reinforcement learning

NEW QUESTION 56
Written requirements are given in text documents, which ONE of the following options is the BEST way to generate test cases from these requirements?
SELECT ONE OPTION

Natural language processing on textual requirements

Analyzing source code for generating test cases

Machine learning on logs of execution

GUI analysis by computer vision

NEW QUESTION 57
Which statement regarding pairwise testing in an AI-based automotive lane-keeping assist system is correct?
Choose ONE option (1 out of 4)

Pairwise testing reduces the test suite so much that it is typically feasible within the available time.

Pairwise testing can reduce testing efforts otherwise very high due to the large number of parameters.

Pairwise testing only uses parameters directly influenced by the driver, otherwise the number of test cases becomes too large.

Pairwise testing is usually insufficient because most defects arise only from interactions of many parameters.

NEW QUESTION 58
Before deployment of an AI based system, a developer is expected to demonstrate in a test environment how decisions are made. Which of the following characteristics does decision making fall under?

Explainability

Autonomy

Self-learning

Non-determinism

Explainability in AI-based systems refers to the ease with which users can determine how the system reaches a particular result. It is a crucial aspect when demonstrating AI decision-making, as it ensures that decisions made by AI models are transparent, interpretable, and understandable by stakeholders.
Before deploying an AI-based system, a developer must validate how decisions are made in a test environment. This process falls under the characteristic of explainability because it involves clarifying how an AI model arrives at its conclusions, which helps build trust in the system and meet regulatory and ethical requirements.
* ISTQB CT-AI Syllabus (Section 2.7: Transparency, Interpretability, and Explainability)
* “Explainability is considered to be the ease with which users can determine how the AI-based system comes up with a particular result”.
* “Most users are presented with AI-based systems as ‘black boxes’ and have little awareness of how these systems arrive at their results. This ignorance may even apply to the data scientists who built the systems. Occasionally, users may not even be aware they are interacting with an AI- based system”.
* ISTQB CT-AI Syllabus (Section 8.6: Testing the Transparency, Interpretability, and Explainability of AI-based Systems)
* “Testing the explainability of AI-based systems involves verifying whether users can understand and validate AI-generated decisions. This ensures that AI systems remain accountable and do not make incomprehensible or biased decisions”.
* Contrast with Other Options:
* Autonomy (B): Autonomy relates to an AI system’s ability to operate independently without human oversight. While decision-making is a key function of autonomy, the focus here is on demonstrating the reasoning behind decisions, which falls under explainability rather than autonomy.
* Self-learning (C): Self-learning systems adapt based on previous data and experiences, which is different from making decisions understandable to humans.
* Non-determinism (D): AI-based systems are often probabilistic and non-deterministic, meaning they do not always produce the same output for the same input. This can make testing and validation more challenging, but it does not relate to explaining the decision-making process.
Supporting References from ISTQB Certified Tester AI Testing Study Guide:Conclusion:Since the question explicitly asks about the characteristic under which decision-making falls when being demonstrated before deployment,explainability is the correct choicebecause it ensures that AI decisions are transparent, understandable, and accountable to stakeholders.

NEW QUESTION 59
A local business has a mail pickup/delivery robot for their office. The robot currently uses a track to move between pickup/drop-off locations. When it arrives at a destination, the robot stops to allow a human to remove or deposit mail. The office has decided to upgrade the robot to include AI capabilities that allow the robot to perform its duties without a track, without running into obstacles, and without human intervention.
The test team is creating a list of new and previously established test objectives and acceptance criteria to be used in the testing of the robot upgrade. Which of the following test objectives will test an AI quality characteristic for this system?

The robot must evolve to optimize its routing

The robot must recharge for no more than six hours a day

The robot must record the time of each delivery which is compiled into a report

The robot must complete 99.99% of its deliveries each day

NEW QUESTION 60
Which statement regarding AI for defect prediction is correct?
Choose ONE option (1 out of 4)

AI-based defect prediction is most effective when based on previous similar constellations.

AI-based defect prediction can detect whether defects exist but not where.

AI-based defect prediction is most effective when based on source-code metrics such as branches or McCabe complexity.

AI-based defect prediction is based on formal principles and requires only a few factors.

NEW QUESTION 61
Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters?
SELECT ONE OPTION

Evaluating the model

Deploying the model

Tuning the model

Data testing

NEW QUESTION 62
Pairwise testing can be used in the context of self-driving cars for controlling an explosion in the number of combinations of parameters.
Which ONE of the following options is LEAST likely to be a reason for this incredible growth of parameters?
SELECT ONE OPTION

Different Road Types

Different weather conditions

ML model metrics to evaluate the functional performance

Different features like ADAS, Lane Change Assistance etc.

Pairwise testing is used to handle the large number of combinations of parameters that can arise in complex systems like self-driving cars. The question asks which of the given options isleast likelyto be a reason for the explosion in the number of parameters.
* Different Road Types (A): Self-driving cars must operate on various road types, such as highways, city streets, rural roads, etc. Each road type can have different characteristics, requiring the car’s system to adapt and handle different scenarios. Thus, this is a significant factor contributing to the growth of parameters.
* Different Weather Conditions (B): Weather conditions such as rain, snow, fog, and bright sunlight significantly affect the performance of self-driving cars. The car’s sensors and algorithms must adapt to these varying conditions, which adds to the number of parameters that need to be considered.
* ML Model Metrics to Evaluate Functional Performance (C): While evaluating machine learning (ML) model performance is crucial, it does not directly contribute to the explosion of parameter combinations in the same way that road types, weather conditions, and car features do. Metrics are used to measure and assess performance but are not themselves variable conditions that the system must handle.
* Different Features like ADAS, Lane Change Assistance, etc. (D): Advanced Driver Assistance Systems (ADAS) and other features add complexity to self-driving cars. Each feature can have multiple settings and operational modes, contributing to the overall number of parameters.
Hence, theleast likelyreason for the incredible growth in the number of parameters isC. ML model metrics to evaluate the functional performance.
:
ISTQB CT-AI Syllabus Section 9.2 on Pairwise Testing discusses the application of this technique to manage the combinations of different variables in AI-based systems, including those used in self-driving cars.
Sample Exam Questions document, Question #29 provides context for the explosion in parameter combinations in self-driving cars and highlights the use of pairwise testing as a method to manage this complexity.