SYS.4
System Integration and Integration Verification
Linked Knowledge Nuggets: arrow_forward "System Integration and Integration Verification"
personAuthor: Process Fellows
SYS.4 – System Integration & Integration Verification focuses on assembling system elements and verifying their interaction against the defined architecture. It ensures that the system behaves as intended through structured test planning, execution, and result tracking.
school
PF_SYS.4_System Integration and Integration Verification_Extract.pdf Short Overview of the SYS.4 System Integration and Integration Verification Process covering base practices, some examples and a comparion between Automotive SPICE® version 3.1 and 4.0
arrow_forward "Systems Engineering - Why the heck do we need this?"
personAuthor: Alexander Feulner
The increasing complexity, shortened development times, distributed development, heightened cost pressures, technological change, and organizational transformations are just a few of the challenges facing the current development.
If these statements seem unfamiliar to you, we congratulate you warmly. For all those who are confronted with these challenges on a daily basis, we present the methodology of ‘Systems Engineering’ in our webinar and answer the question: "Why the heck do we need this?". This webinar is tailored not only for system developers but also for professionals in various domains including software development, hardware development, testing, project management and more.
school
Webinar recording and slides
arrow_forward "Testmanagement"
personAuthor: Process Fellows
Test Management ensures that testing activities are strategically planned, monitored, and evaluated across all development phases. From unit tests to system-level integration, this cross-cutting discipline defines methods, tools, documents, and roles to ensure traceable and efficient verification and validation.
school
PF_Testmanagement_Extract.pdf Short Overview of Test Management (related to all Automotive SPICE® verification processes)
arrow_forward "Verification level vs. Verification timepoint"
personAuthor: Process Fellows
The execution of a verification measure is not necessarily linked to the verification time point.
It is possible that a verification measure from SWE.6 is carried out as part of the verification of the SW component and integration verrifcation if the setup or the environment is better suited to this.
However, it remains a verification of the SW requirements.
The decisive factor is what a verification measure is derived from.
However, it is important to ensure that this verification measure is included in and part of the report and in the summary of the SW verification.
Pay attention to the sequences and dependencies to be followed.
# PROCESS PURPOSE
The purpose is to integrate systems elements and verify that the integrated (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
) are consistent with the system architecture.
# PROCESS OUTCOMES
O1 (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) are specified for system integration (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) of the integrated (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
) based on the system architecture, including the interfaces of, and interactions between, (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
).
O2 (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
) are integrated up to a complete integrated system consistent with the (Release = A physical product delivered to a customer, including a defined set of functionalities and properties.) scope.
O3 (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) are selected according to the (Release = A physical product delivered to a customer, including a defined set of functionalities and properties.) scope considering criteria, including criteria for (Regression verification = Selective re-verification of elements to verify that modifications have not caused unintended effects.).
O4
Integrated (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
) are verified using the selected (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.), and the results of the system integration (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) are recorded.
O5
Consistency and bidirectional traceability are established between (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) and the elements of the system architecture.
O6
Bidirectional traceability between (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) results and (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) is established.
O7
Results of the system integration and integration (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) are summarized and communicated to all affected parties.
# BASE PRACTICES
BP1
Specify verification measures for system integration. (
O1 )
Specify the (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.), based on a defined sequence and preconditions for the integration of (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
) against the system static and dynamic aspects of the system architecture, including
techniques for the (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.),
pass/fail criteria for (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.),
a definition of entry and exit criteria for the (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.), and
the required (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) infrastructure and environment setup.
Note 1: Examples on what a (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) may focus are the timing dependencies of the correct signal flow between interfacing (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
), or interactions between (Hardware = Assembled and interconnected electrical or electronic hardware components or parts which perform analog or digital functions or operations.) and software, as specified in the system architecture. The system integration test cases may focus on
the correct signal flow between system items,
the timeliness and timing dependencies of signal flow between system items,
the correct interpretation of signals by all system items using an interface, and/or
the dynamic interaction between system items.
BP2
Select verification measures. (
O3 )
Document the selection of (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) for each integration step considering selection criteria including criteria for (Regression verification = Selective re-verification of elements to verify that modifications have not caused unintended effects.). The documented selection of (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) shall have sufficient coverage according to the (Release = A physical product delivered to a customer, including a defined set of functionalities and properties.) scope. Note 2: Examples for selection criteria can be prioritization of requirements, the need for (Regression verification = Selective re-verification of elements to verify that modifications have not caused unintended effects.) (due to e.g., changes to the system architectural design or to system components), or the intended use of the delivered product (Release = A physical product delivered to a customer, including a defined set of functionalities and properties.) (e.g., test bench, test track, public road etc.)
BP3
Integrate system elements and perform integration verification. (
O2, O4 )
Integrate the (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
) until the system is fully integrated according to the specified interfaces and interactions between the (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
), and according to the defined sequence and defined preconditions. Perform the selected system integration (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.). Record the (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) data including pass/fail status and corresponding (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) data. Note 3: Examples for preconditions for starting system integration can be successful (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
) (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) or qualification of pre-existing (System Element = System elements can be:
Logical and structural objects at the architectural and design level. System elements can be further decomposed into more fine-grained system elements of the architecture or design across appropriate hierarchical levels.
Physical representations of these objects, or a combination, e.g., peripherals, sensors, actuators, mechanical parts, software executables.
). Note 4: See SUP.9 for handling (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) results that deviate from expected results
Linked Knowledge Nuggets: arrow_forward "Archiving test results"
personAuthor: Process Fellows
Don’t lose your evidence. With perspective to testing, SUP.8.BP1 in combination with SUP.8.BP8 expects structured storage of test logs, verdicts, anomalies, and configuration info. This is not only a formality: It enables you to later on reproduce details about a certain system version.
Ensure consistency and establish bidirectional traceability between (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) and the system architecture. Establish bidirectional traceability between (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) results and (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.). Note 5: Bidirectional traceability supports consistency, and facilitates impact analysis of change requests, and demonstration of (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) coverage. Traceability alone, e.g., the existence of links, does not necessarily mean that the information is consistent with each other.
Linked Knowledge Nuggets: arrow_forward "Consistency vs. Traceability – What’s the Difference?"
personAuthor: Process Fellows
Consistency ensures that related content doesn’t contradict itself – e.g., requirements align with architecture and test. Traceability, in contrast, is about links: can you follow a requirement through to implementation and verification? Both are needed – consistency builds trust, traceability enables control. Typically, traceability strongly supports consistency review.
arrow_forward "The role of traceability in risk control"
personAuthor: Process Fellows
Traceability isn’t just about completeness — it’s about managing impact. When a requirement changes, trace links tell you what’s affected. That’s your early-warning system.
arrow_forward "The true benefit of traceability
"
personAuthor: Process Fellows
Sometimes the creation of traceability is seen as an additional expense, the benefits are not recognized.
Traceability should be set up at the same time as the derived elements are created. Both work products are open in front of us and the creation of the trace often only takes a few moments.
In the aftermath, the effort increases noticeably and the risk of gaps is high.
If the traceability is complete and consistent, the discovery of dependencies is unbeatably fast and reliable compared to searching for dependencies at a later stage, when there may also be time pressure.
It also enables proof of complete coverage of the derived elements and allows the complete consistency check.
BP5
Summarize and communicate results. (
O7 )
Summarize the system integration and integration (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) results and communicate them to all affected parties. Note 6: Providing all necessary information from the test case execution in a summary enables other parties to judge the consequences.
# OUTPUT INFORMATION ITEMS
13-52
Communication evidence (
O7 )
All forms of interpersonal communication such as
e-mails, also automatically generated ones
tool-supported workflows
meeting, verbally or via meeting minutes (e.g., daily standups)
podcast
blog
videos
forum
live chat
wikis
photo protocol
Used by these processes:
ACQ.4 Supplier Monitoring
HWE.1 Hardware Requirements Analysis
HWE.2 Hardware Design
HWE.3 Verification against Hardware Design
HWE.4 Verification against Hardware Requirements
MAN.3 Project Management
MLE.1 Machine Learning Requirements Analysis
MLE.2 Machine Learning Architecture
MLE.3 Machine Learning Training
MLE.4 Machine Learning Model Testing
PIM.3 Process Improvement
REU.2 Management of Products for Reuse
SUP.1 Quality Assurance
SUP.11 Machine Learning Data Management
SWE.1 Software Requirements Analysis
SWE.2 Software Architectural Design
SWE.3 Software Detailed Design and Unit Construction
SWE.4 Software Unit Verification
SWE.5 Software Component Verification and Integration Verification
SWE.6 Software Verification
SYS.1 Requirements Elicitation
SYS.2 System Requirements Analysis
SYS.3 System Architectural Design
SYS.4 System Integration and Integration Verification
SYS.5 System Verification
VAL.1 Validation
Used by these process attributes:
PA2.1 Performance Management
13-51
Consistency Evidence (
O5, O6 )
Demonstrates bidirectional traceability between artifacts or information in artifacts, throughout all phases of the life cycle, by e.g.,
tool links
hyperlinks
editorial references
naming conventions
Evidence that the content of the referenced or mapped information coheres semantically along the traceability chain, e.g., by
performing pair working or group work
performing by peers, e.g., spot checks
maintaining revision histories in documents
providing change commenting (via e.g., meta-information) of database or repository entries
Note: This evidence can be accompanied by e.g., Definition of Done (DoD) approaches.
Used by these processes:
HWE.1 Hardware Requirements Analysis
HWE.2 Hardware Design
HWE.3 Verification against Hardware Design
HWE.4 Verification against Hardware Requirements
MAN.3 Project Management
MLE.1 Machine Learning Requirements Analysis
MLE.2 Machine Learning Architecture
MLE.3 Machine Learning Training
MLE.4 Machine Learning Model Testing
SUP.8 Configuration Management
SUP.10 Change Request Management
SWE.1 Software Requirements Analysis
SWE.2 Software Architectural Design
SWE.3 Software Detailed Design and Unit Construction
SWE.4 Software Unit Verification
SWE.5 Software Component Verification and Integration Verification
SWE.6 Software Verification
SYS.2 System Requirements Analysis
SYS.3 System Architectural Design
SYS.4 System Integration and Integration Verification
SYS.5 System Verification
VAL.1 Validation
11-06
Integrated System (
O2 )
Integrated product
(Application parameter = An application parameter is a software variable containing data that can be changed at the system or software levels; they influence the system’s or software behavior and properties. The notion of application parameter is expressed in two ways:
The specification (including variable names, the domain value range, technical data types, default values, physical unit (if applicable), the corresponding memory maps, respectively).
The actual quantitative data value it receives by means of data application.
Application parameters are not requirements. They are a technical implementation solution for configurability-oriented requirements.) files (being a technical implementation solution for configurability-oriented requirements)
All configured elements for the product (Release = A physical product delivered to a customer, including a defined set of functionalities and properties.) are included
Used by these processes:
SYS.4 System Integration and Integration Verification
06-50
Integration Sequence Instruction (
O2 )
Identification of required physical elements (e.g., (Hardware = Assembled and interconnected electrical or electronic hardware components or parts which perform analog or digital functions or operations.), mechanical, wiring elements), and software executables and (Application parameter = An application parameter is a software variable containing data that can be changed at the system or software levels; they influence the system’s or software behavior and properties. The notion of application parameter is expressed in two ways:
The specification (including variable names, the domain value range, technical data types, default values, physical unit (if applicable), the corresponding memory maps, respectively).
The actual quantitative data value it receives by means of data application.
Application parameters are not requirements. They are a technical implementation solution for configurability-oriented requirements.) (being a technical implementation solution for configurability-oriented requirements)
necessary sequence or ordering of integration
preconditions for starting system integration
Used by these processes:
SWE.5 Software Component Verification and Integration Verification
SYS.4 System Integration and Integration Verification
08-60
Verification Measure (
O1 )
A (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) can be a test case, a (Measurement = “The activity to find the size, quantity or degree of something”.), a calculation, a simulation, a review, an optical inspection, or an analysis
The specification of a (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) includes
pass/fail criteria for (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) (test completion and ending criteria)
a definition of entry and exit criteria for the (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.), and abort and re-start criteria
Techniques (e.g., black-box and/or white-box-testing, equivalence classes and boundary values, fault injection for Functional Safety, penetration testing for Cybersecurity, back-to- back testing for model-based development, ICT)
Necessary (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) environment and infrastructure
Necessary sequence or ordering
Used by these processes:
HWE.3 Verification against Hardware Design
HWE.4 Verification against Hardware Requirements
SWE.4 Software Unit Verification
SWE.5 Software Component Verification and Integration Verification
SWE.6 Software Verification
SYS.4 System Integration and Integration Verification
SYS.5 System Verification
03-50
Verification Measure Data (
O4 )
(Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) data are data recorded during the execution of a (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.), e.g.:
for test cases: raw data, logs, traces, tool generated outputs
(Measurement = “The activity to find the size, quantity or degree of something”.): values
calculations: values
simulations: protocol
reviews such as optical inspections à findings record
analyses: values
Used by these processes:
HWE.3 Verification against Hardware Design
HWE.4 Verification against Hardware Requirements
SWE.4 Software Unit Verification
SWE.5 Software Component Verification and Integration Verification
SWE.6 Software Verification
SYS.4 System Integration and Integration Verification
SYS.5 System Verification
08-58
Verification Measure Selection Set (
O3 )
Include criteria for re- (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) in the case of changes (regression).
Identification of (Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.), also for regression testing
Used by these processes:
HWE.3 Verification against Hardware Design
HWE.4 Verification against Hardware Requirements
SWE.4 Software Unit Verification
SWE.5 Software Component Verification and Integration Verification
SWE.6 Software Verification
SYS.4 System Integration and Integration Verification
SYS.5 System Verification
15-52
Verification Results (
O4 )
(Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) data and logs
(Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) passed
(Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) not passed
(Verification measure = Verification measure can be:
Test cases
Measurements
Calculations
Simulations
Reviews
Analyses
Note, that in particular domains certain verification measures may not be applicable, e.g., software units generally cannot be verified by means of calculations or analyses.) not executed
information about the test execution (date, tester name etc.)
Abstraction or summary of (Verification = Verification is confirmation through the provision of objective evidence that an element fulfils the specified requirements.) results
Used by these processes:
HWE.3 Verification against Hardware Design
HWE.4 Verification against Hardware Requirements
SWE.4 Software Unit Verification
SWE.5 Software Component Verification and Integration Verification
SWE.6 Software Verification
SYS.4 System Integration and Integration Verification