DESCRIPTION
The code presented in this repository is a formal representation of the semantics of a system level test run in a keyword-driven testing framework, Robot Framework. The semantics are expressed in Haskell and can be executed using GHC(i).
CONTENTS
- RobotSemantics: The semantic definitions for a test run in Robot Framework
- TypedArgumentsExtension: The semantics of an extension written for Robot Framework
- Examples: Three examples, demonstrating the relation between the semantic definitions and actual Robot Framework test cases and keyword libraries.
SHORT SUMMARY
System level acceptance tests should cover a large amount of traces in a system under test, for which many testing paradigms exist. However, system level acceptance tests are required to be understood by many stakeholders, which is not always taken into consideration when a system level testing paradigm is designed. Combining two or more paradigms might yield a system level testing approach which can get the best of both worlds. To see whether this is the case for keyword-driven testing, we consider a triad of system level testing paradigms: Behavior-Driven Testing, Model-Based Testing and Test Data Generation. In the thesis we introduce a formal semantic definition of a keyword-driven testing framework, Robot Framework, to be able to reason about what the considered paradigms would entail for a case study at Canon Production Printing. For each of the three considered paradigms, a conclusion is drawn as to whether the paradigm could benefit from a combination with keyword-driven testing and what the relation between the paradigm and keyword-driven testing would be in such a combination.
The executable semantics presented in this repository ought to provide an unambiguous starting point for reasoning about the keyword-driven testing paradigm. Moreover, the executable semantics are used to express semantic implications of additional concepts and extensions for keyword-driven testing with Robot Framework.
"}}]},{"typeName":"subject","multiple":true,"typeClass":"controlledVocabulary","value":["Computer and Information Science"]},{"typeName":"keyword","multiple":true,"typeClass":"compound","value":[{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"software testing"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"keyword-driven testing"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Robot Framework"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"executable semantics"}},{"keywordValue":{"typeName":"keywordValue","multiple":false,"typeClass":"primitive","value":"Haskell"}}]},{"typeName":"language","multiple":true,"typeClass":"controlledVocabulary","value":["English"]},{"typeName":"productionDate","multiple":false,"typeClass":"primitive","value":"2021-01-01"},{"typeName":"distributionDate","multiple":false,"typeClass":"primitive","value":"2021-01-28"},{"typeName":"dateOfDeposit","multiple":false,"typeClass":"primitive","value":"2021-02-11"}]},"dansRights":{"displayName":"Rights Metadata","name":"dansRights","fields":[{"typeName":"dansRightsHolder","multiple":true,"typeClass":"primitive","value":["Radboud University"]},{"typeName":"dansPersonalDataPresent","multiple":false,"typeClass":"controlledVocabulary","value":"Unknown"}]},"dansRelationMetadata":{"displayName":"Relation Metadata","name":"dansRelationMetadata","fields":[{"typeName":"dansAudience","multiple":true,"typeClass":"primitive","value":["https://www.narcis.nl/classification/D16000"],"expandedvalue":[{"@id":"https://www.narcis.nl/classification/D16000","termName":[{"lang":"en","value":"Computer science"},{"lang":"nl","value":"Informatica"}],"vocabularyUri":"https://www.narcis.nl/classification/"}]},{"typeName":"dansRelation","multiple":true,"typeClass":"compound","value":[{"dansRelationType":{"typeName":"dansRelationType","multiple":false,"typeClass":"controlledVocabulary","value":"relation"},"dansRelationText":{"typeName":"dansRelationText","multiple":false,"typeClass":"primitive","value":"Tretmans, G.J. (2020). Data Management Plan: MasCot TiCToC - Testing in Times of Continuous Change. [data management plan]."}}]}]},"dansDataVaultMetadata":{"displayName":"Data Vault Metadata","name":"dansDataVaultMetadata","fields":[{"typeName":"dansDataversePid","multiple":false,"typeClass":"primitive","value":"doi:10.17026/dans-zr6-u5q2"},{"typeName":"dansDataversePidVersion","multiple":false,"typeClass":"primitive","value":"2.0"},{"typeName":"dansBagId","multiple":false,"typeClass":"primitive","value":"urn:uuid:ccaae699-7a82-4f09-b3dd-ed868a8d367d"},{"typeName":"dansNbn","multiple":false,"typeClass":"primitive","value":"urn:nbn:nl:ui:13-qw-5kby"}]}},"files":[{"description":"","label":"easy-migration.zip","restricted":false,"version":2,"datasetVersionId":1107,"dataFile":{"id":67683,"persistentId":"","filename":"easy-migration.zip","contentType":"application/zip","friendlyType":"ZIP Archive","filesize":16373,"description":"","storageIdentifier":"surf://store:18bbf882caf-16dc11e40e8f","rootDataFileId":67658,"previousDataFileId":67658,"checksum":{"type":"SHA-1","value":"144287c96c0042d0e66d1c94eed14755650f0ebe"},"tabularData":false,"creationDate":"2023-11-11","publicationDate":"2021-02-16","lastUpdateTime":"2023-11-11T17:57:36Z","fileAccessRequest":false}},{"description":"","label":"ExecutableSemantics.zip","restricted":false,"directoryLabel":"data","version":1,"datasetVersionId":1107,"dataFile":{"id":67661,"persistentId":"","filename":"ExecutableSemantics.zip","contentType":"application/zip","friendlyType":"ZIP Archive","filesize":55941,"description":"","storageIdentifier":"surf://store:18bbf87eba9-b15c8db45f19","rootDataFileId":-1,"checksum":{"type":"SHA-1","value":"8828eb85e668716f20574261fcfd102c68c2e0b2"},"tabularData":false,"creationDate":"2023-11-11","publicationDate":"2021-02-16","directoryLabel":"data","lastUpdateTime":"2023-11-11T17:57:36Z","fileAccessRequest":false}},{"description":"","label":"README.md","restricted":false,"directoryLabel":"data","version":1,"datasetVersionId":1107,"dataFile":{"id":67659,"persistentId":"","filename":"README.md","contentType":"text/markdown","friendlyType":"Markdown Text","filesize":2432,"description":"","storageIdentifier":"surf://store:18bbf87eac1-bcfc216f7b83","rootDataFileId":-1,"checksum":{"type":"SHA-1","value":"2fdc5e6d23c9cd76f75b7baddfe5eaa76fa4187c"},"tabularData":false,"creationDate":"2023-11-11","publicationDate":"2021-02-16","directoryLabel":"data","lastUpdateTime":"2023-11-11T17:57:36Z","fileAccessRequest":false}}]}}}