#Property evaluator software how to
#Property evaluator software manual
#Property evaluator software software
#Property evaluator software code

RQ 1: Can the individual student contributions in team-coding assignments be automatically assessed? Accurate metrics would be desirable to measure how much of the performance of a team is due to each of the members. In this paper, we deal with with two main research questions:

#Property evaluator software how to

To the best of our knowledge, no proposal has been made as to how to assess DevOps practices during a team-coding assignment. The use of VCS in coding assignments offers opportunities to gather insightful information about the coding process that has been exploited in the development of automated student assessment methods (Hamer et al., 2021 Macak et al., 2021).

#Property evaluator software code

We found only one metric based on the frequency of code edits (Hamer et al., 2021), but this metric is very rough and inaccurate, because wrong edits are counted positively.

Little progress has been reported in the literature toward this goal. It is desirable to develop methods that assess individual contributions, so that the contribution of individual students can be traced for personal grading (Planas-Llado et al., 2021 Britton et al., 2017). Such metrics can be used to assess the performance of a team as a whole, but grading students by the overall performance of the team is ineffective for passive students, and can lead to tensions within the team and lack of motivation of the most brilliant students (Petkova et al., 2021).

#Property evaluator software software

Most of the works found in the literature are based on software testing techniques (Strandberg et al., 2022), which provide measurable metrics to assess the correctness of the code written by the students (Gaona et al., 2021 Gonzalez-Carrillo et al., 2021 Hegarty-E & Mooney, 2021). Thus, automated assessment methods are a current hot research track on computer science education methodologies (Cai & Tsai, 2019 Gaona et al., 2021 Gonzalez-Carrillo et al., 2021 Gordillo, 2019 Hegarty-E & Mooney, 2021).

#Property evaluator software manual

The manual assessment of coding assignments can be very time-consuming for lecturers. The current increasing interest on DevOps (Khan et al., 2022) makes the resulting learning outcome very interesting. Some coding courses go one step further and involve the use of some of the automated processes used in DevOps for improved software quality. Using a VCS in a coding assignment provides a learning outcome to the student that can be assessed by itself. Version Control Systems (VCS) offer functionalities for this purpose such as tracking changes, version control, code merging, and so on. These changes by different team members need to be integrated in a coordinated and orderly manner. In these scenarios, each team member works on his/her own personal computer, and makes changes to the team’s shared code-base. It is usual in introductory courses that students work in pairs over a single version of the code, but in more advanced courses, it is often preferred that students work in groups to develop of soft skills such as teamwork, that are highly desirable by future employers (De Prada et al., 2022). To overcome these assignments, students need to complete (or write from scratch) code that satisfies a specification provided by the lecturers. Qualitative evaluation of the students filling relevant questionnaires are very positive and encouraging.Ĭomputer Science courses often include team-coding assignments during the learning and student evaluation process. Additionally, we use other assessment methods to calculate the final grade: written conceptual tests to check their understanding of the development processes, and cross-evaluations. We have used it as the main source of information for student and team assessment in one programming course. Although this method is not intended to produce the final grade of each student, it provides very valuable information to the lecturers. This process also facilitates the process of assessing the assignments. Periodically scheduled reports using these metrics provide students valuable feedback. The methodology also defines Individual Performance Metrics to measure the impact of individual student contributions to increase in Team Performance Metrics. It tracks the progress on each of metric by each group. This system and methodology includes the definition of Team Performance Metrics measuring properties of the software developed by each team, and their correct use of DevOps techniques. We describe an automated assessment process for team-coding assignments based on DevOps best practices.