- Research
- Open access
- Published:
Designing and evaluating an augmented reality system for an engineering drawing course
Smart Learning Environments volume 11, Article number: 1 (2024)
Abstract
Currently, augmented reality (AR) is one of the emerging technologies which is being widely used in the education sector. In engineering drawing, AR has been implemented to enhance learners’ spatial ability but not their conceptual knowledge yet. Therefore, this study aims to evaluate the effect of AR on engineering drawing students’ learning performance. In this study, we developed an AR-based application EDINAR to learn engineering drawing concepts for undergraduate engineering students. The study included 392 first-year students from an engineering institution. The control group (N = 196) studied engineering drawing using traditional methods, whereas the experimental group (N = 196) used an AR-based engineering drawing application (EDINAR) to learn engineering drawing. One-way ANOVA was used to analyse the performances of both groups. The findings revealed that students studying engineering drawing with the help of EDINAR outperformed those using traditional approaches. In addition, we received positive feedback about the AR application from the experimental group about their learning experience. Based on these results, it is recommended to incorporate AR in engineering education to improve the learning performance and students’ learning experience.
Introduction
Engineering Drawing (ED) courses play an important role in Engineering Education (Lagenbach et al., 2015). They enable engineers to draw in detail, and read, comprehend, and interpret technical drawings which are necessary for technical exchanges (Bao et al., 2020). Additionally, the main objectives of ED courses are the cultivation of students’ spatial skills, knowledge, design ability, creativity, and thinking skills (Liang et al., 2018).
Due to the rise of emerging engineering technologies, such as interactive designs as well as digital and intelligent manufacturing, several changes have been brought about in ED courses (Liang et al., 2018). The integration of Information and Communication Technology (ICT) in ED courses can enrich teaching and learning activities (Lanzotti et al., 2019). Particularly, the use of Computer-Aided Drawing (CAD) software for 2-dimensional and 3-dimensional drawings has transformed ED and enabled engineers to communicate using a formalized and common language (Lagenbach et al., 2015). CAD software refers to the use of computer systems to draw, modify, analyze, and optimize designs and drawings (Kosa & Karakuş, 2018). It is widely used to draw, generate, and validate drawings and designs while also reducing human effort and errors (Kosa & Karakuş, 2018; Rica et al., 2020).
Spatial and visualization skills are essential in ED (Tumkor and de Vries, 2015). Although the integration of CAD software can improve these skills (Rafi et al., 2006), it is not enough to effectively teach ED courses and assist students in comprehending complex concepts (Omar et al., 2019). In addition, due to time constraints and the large number of students in classes, students do not receive sufficient guidance and individual attention (Ariffin et al., 2017; Liang et al., 2018). Another determining factor that hinders students’ ED education is the lack of hands-on experiences which leads to a disconnection between theoretical knowledge and practical skills (Bao et al., 2020). It is important for ED courses to address students’ needs, maintain their interest and engagement, and meet their expectations (Shreeshail et al., 2020). Therefore, it is essential to enrich and reform teaching contents and methods of engineering drawing courses to develop engineers with strong scientific foundations, engineering skills, technological capabilities, and multidisciplinary knowledge. Furthermore, there is a clear need for a cultural shift (Vere et al., 2011), an increase in practical experiences (Jianqing & Zibin, 2015), and a focus on improving spatial and visualization skills (Marunic & Glazar, 2013; Sorby et al., 2013).
To transform and improve the effectiveness and quality of ED courses, new methods to teach ED, such as mobile learning, innovative case teaching, seminar teaching, and immersive learning, are being adopted (Liang et al., 2018). Augmented Reality (AR) is a technology that overlays digital information, such as images, videos, or interactive data, onto the real world. AR enhances the user's perception of the real world by adding digital elements to it (Azuma, 1997). Particularly, the use of AR as a means to enrich and improve ED courses is gaining ground, due to AR characteristics and potentials (Ali et al., 2017b). The integration of AR in engineering drawing courses offers numerous advantages. AR technology transforms static 2D engineering drawings into interactive 3D visualizations, enhancing students' understanding of complex geometries and spatial relationships in real-world scenarios (Danakorn Nincarean et al., 2019). It provides valuable real-time feedback by allowing students to overlay digital sketches on physical objects, accelerating the learning process. AR enriches the educational experience by adding interactivity, enabling students to engage with 3D models and simulate design changes, making learning more enjoyable (Martin-Gutierrez et al., 2012). Additionally, it fosters the development of essential skills such as digital design, 3D modelling, and technology integration, all crucial in the engineering field (Camba et al., 2014). Furthermore, AR promotes inclusivity by catering to various learning styles; visual learners benefit from dynamic visualizations, while tactile learners can interact with virtual 3D objects (Dorribo-Camba & Contero, 2013). AR also encourages critical thinking and creative problem-solving by encouraging students to experiment with different design iterations and evaluate outcomes promptly (Chin et al., 2019). Subsequently, the purpose of this study is to investigate the impact of augmented reality on the performance of students enrolled in an ED course. Specifically, the research questions (RQ) that it seeks to address are the following:
-
RQ1—Can the AR-based application improve students’ learning performance in engineering drawing course compared to the conventional instruction method?
-
RQ2—Are there any significant differences in learners’ performance for students of different achievement levels (based on PSVT-R scores) between the experimental and control groups?
-
RQ3—How satisfied are the students with AR-based learning activity?
Literature review
Engineering drawing course
Modern engineers need to have advanced planning and drawing skills to be successful (Bertoline and Wiebe, 2005). ED is the universal language of engineers which can be applied in several domains (Rica et al., 2020) and contains detailed specifications concerning designs and products (Ali et al., 2022). Additionally, it is strongly connected with engineering practices, involves hands-on experiences, and is supported by rigorous theories (Mu et al., 2021). ED fosters higher-order thinking skills and prepares engineering students to propose effective solutions for real-world problems (Sharma et al., 2020). Hence, it is regarded as an important course in engineering science (Sharma et al., 2020).
Being able to draw, read, and interpret EDs efficiently is necessary for research and technical exchange (Bao et al., 2020) and exert significant impact throughout the design and production processes (Shreeshail & Koti, 2016). Therefore, ED courses aim at enabling students to learn the theory, methods, and tools to read and draw EDs. Moreover, they focus on cultivating engineers who have high-quality technical and practical skills, pursue innovation, can solve complex problems, follow the graphical language rules, and can convey their thoughts in a clear and comprehensible manner, so they can easily be interpreted and executed (Chang, 2012; Mu et al., 2022; Raffaeli et al., 2019). ED is differentiated from other engineering subjects as it requires spatial and visualization skills and is used as a means of graphical communication (Olkun, 2003; Sharma et al., 2020). The projection theory, which is the representation of 3-D objects on 2D media, as well as mechanical and basic drawing are fundamental components of ED which help students cultivate their critical thinking and reasoning skills, and convey their ideas (Gorgani and Pak, 2020; Jianqing & Zibin, 2015).
ED courses have been evolving from just using vellum paper, drafting boards, and hand tools to integrating 2D-CAD and 3D-CAD tools to address the problems faced by students when learning through traditional methods (Garland et al., 2017; Kösa & Karakuş, 2018). Various factors lead to students experiencing difficulties in ED courses. In their study, Ali et al. (2017a) pointed out that a significant challenge for students arises from their limited ability to visualize 2D representations and 3D objects. Serdar et al. (2013) also noted that this issue becomes more pronounced when dealing with complex concepts like orthographic and isometric projections. Students also experience problems imagining the space when they observe projection drawings containing 3D objects (Tsutsumi, 2004). Visualizing complex concepts or rare phenomena is another challenge that students face (Nordin et al., 2013). ED is characterized by hierarchical design meaning that the comprehension of one concept depends on the understanding of another (Yasin et al., 2012). As a result, the lack of visualization skills makes it more difficult for the students to learn and actively participate in learning activities when they do not understand the content being taught (Ali et al., 2022; Baronio et al., 2016). Bao et al. (2020) highlighted additional factors contributing to challenges in ED course. Such as, ineffective evaluation techniques, the presence of outdated and excessive content, along with a deficiency in impactful and engaging teaching methods, insufficient instructional hours, and limited hands-on learning opportunities.
Recent studies have explored the use of ICT tools to teach ED courses. Studies, such as (Jianqing & Zibin, 2015; Kösa & Karakuş, 2018), investigated the use of CAD software to transform traditional ED courses and improve teaching and learning activities. Their results showcased that CAD software can lead to increased learning outcomes when compared to traditional methods and allow students to get a better understanding of the concepts taught. Studies have also looked into novel ways to assess ED courses more effectively (Gorgani & Pak, 2020). Other studies explored the use of interactive multimedia (Widayana et al., 2020), web-based interactive 3D concept maps (Violante & Vezzetti, 2015), and e-book multimedia (Mujiarto et al., 2019). Their results showed that multimedia and interactive means can improve students’ motivation and independence while also increasing their understanding of ED course concepts and helping them build effective mental representations of learning contents, thus, leading to better student performance. Studies have also examined integrating ICT tools to offer online ED courses. Particularly, the studies involved the use of Massive Open Online Courses (MOOCs) (Lanzotti et al., 2019), blended learning environments (Szeto & Cheng, 2016), and comparisons between online and traditional face-to-face ED courses (Mu et al., 2021; Raffaeli et al., 2019; Wang et al., 2019). According to their results, no significant differences were observed in terms of learning effectiveness. Besides the use of ICT, studies looked into the use of project-based learning (Mingxia, 2021) and problem-based learning (Ariffin et al., 2017; Shreeshail et al., 2020; Yasin et al., 2012) approaches to improve the efficiency of ED courses. These approaches led to increased students’ engagement, learning achievement, critical thinking, and problem-solving skills. The use of immersive technologies, such as AR, is becoming more popular in teaching ED courses as it can bring about positive outcomes (Ali et al., 2017b).
Augmented reality and its effectiveness
AR is closer to the real physical environment in the “reality-virtuality continuum” (Milgram & Kishino, 1994). Aiming at enriching the physical environment that surrounds users, AR uses computational units to create digital objects and embed them in the real environment as it is perceived by the users in the appropriate time and space (Azuma, 1997; Lampropoulos et al., 2022; Thomas & David, 1992). AR uses different types of media, such as non-interactive, interactive AR, and interactive non-AR media, with interactive AR media being the most effective for educational purposes (Ali et al., 2017b). Moreover, AR applications can be categorized into triggered (e.g., projection-based, location-based, dynamic augmentation, and complex augmentation) and view-based ones (e.g., indirect augmentation, and non-specific digital augmentation) (Edwards-Stewart et al., 2016). Brito and Stoyanova (2018) explained that AR applications can be categorised into marker-based or marker-less, depending on whether they use markers or not. Marker-based AR relies on predefined markers like images or patterns to anchor digital content in the real world, offering precise and stable AR experiences. In contrast, markerless AR doesn't require markers and uses computer vision to track the environment, providing more versatility but potentially sacrificing precision (Cheng et al., 2017).
Due to its immersive nature and its ability to combine the real environment with digital environments, AR can be adopted and used in educational settings (Garzón et al., 2019; Lee, 2012). Moreover, AR supports learning theories that are based on constructivism, such as cognitive flexibility, case-based learning, simulations, and collaborative learning (Dunleavy & Dede, 2014). It supports hands-on practices, promotes students’ innovative ability, affects their knowledge acquisition, and allows them to experience real-world scenarios and environments safely (Liang et al., 2018; Wu et al., 2013). Through AR, flexible and interactive learning environments that support the cultivation of vital critical skills (e.g., critical thinking, problem-solving, emotional intelligence, etc.) (Spiro et al., 2003) and improve students’ emotions, creativity, and thinking ability (Lin et al., 2014) can be created. These environments have the potential to support multiple representations of objects, allow learners to develop cognitively flexible processing skills, and facilitate the comprehension of concepts from ill-structured knowledge domains.
Due to the benefits that AR can potentially yield, recent studies explored its use in ED courses. Ali et al. (2017b) conducted a systematic literature review to investigate the impact of AR on ED courses. Their findings demonstrated that AR was well-received by both students and teachers, increased students’ visualization skills and comprehension of complex concepts, and improved the overall learning experience. AR can be a powerful tool for improving the spatial abilities of students by providing immersive, interactive, and personalized learning experiences that promote spatial understanding and problem-solving skills (Contero et al., 2012; Dünser et al., 2006; Martín-Gutiérrez et al., 2015). Serdar (2016) emphasized improving students’ visualization and understanding of 3D objects from 2D views through the use of mixed reality technologies. Their results revealed that mixed reality applications can improve students’ comprehension of complex concepts and allow students to observe objects from multiple angles and interact with them. Ali et al. (2017a) focused on addressing the problems that students face in ED courses through AR environments. Their results revealed that when using AR, students comprehended and combined 2D objects more easily. Zhang et al. (2021) explored the use of AR in engineering courses with an emphasis on collaborative assembly training. Learners evaluated the overall experience as positive and the application as easy to use. Although studies started to explore the viability of AR as an ED teaching tool, the need for more empirical studies to analyze the effect and potential of interactive and flexible AR applications in ED courses is imperative (Ali et al., 2017b). Additionally, it is essential to explore new teaching methods and approaches that will result in the transformation of the educational process and facilitate the learning of complex concepts within ED courses (Liang et al., 2018).
Within the current body of literature, several studies have initiated the investigation of Augmented Reality (AR) as a pedagogical tool for Educational Technology (ED) courses. Notably, Ali et al. (2017a) specifically evaluated the impact of AR on students' spatial abilities but did not extend the analysis to encompass its influence on learning performance in ED courses. Our study endeavors to contribute to the field by addressing this notable research gap. Thus, our primary objective is to assess the effectiveness of AR in enhancing students' learning performance within the context of ED courses. Additionally, our research investigates the impact of AR integration on students' learning performance, considering variations in achievement levels.
Methodology
Research design and sample
In the first phase of the study, we conducted a pilot survey with fifty-three undergraduate engineering students to identify their difficulties in studying ED courses. The data were collected from an engineering college located in the eastern part of India. In addition, we consulted eighteen subject experts from an engineering institute to understand the challenges faced by the students in understanding some concepts in the ED course. These experts have more than 10 years of experience in teaching ED courses. Table 1 provides some of the feedback from the experts. In the survey, it was identified that some complex concepts such as cross-sections of solids and projections of lines, points, solids, and planes which the students faced difficulties in visualizing. We employed a true experimental design. It included 392 (Males = 291, Females = 101) students in total. These students ranged in age from 19 to 22 and were chosen from an engineering institution. The students were selected at random from the first-year Undergraduate engineering course. We used a random sampling technique for selecting students for the experiment. Both groups—the experimental group and the control group had 196 students each. While the control group continued to study ED using a traditional method, the experimental group used the AR application for ED to do so. Table 2 shows the demographic statistics of the students who participated in the study.
Design and illustration of augmented reality-based engineering drawing application
In this study, we used UnityFootnote 1 software to create an augmented reality-based engineering drawing application (EDINAR) to improve engineering drawing students’ learning outcomes and motivation. With reference to suggestions by subject experts, the application was composed of seven modules: orthographic view, auxiliary plane, projection of solids, projection of lines, projection of points, projection of planes and cross-section of solids. The user must point the in-device camera at the target image (see Fig. 1) to start using the application since it is a marker-based app. EDINAR begins with a list of the modules it contains (see Fig. 2). The user had to tap on one of these modules to open it. Then, 3D AR shapes will appear on the user’s interface with various functions attached to them (Fig. 3). The application permits users to resize, rotate, and view shapes and planes from a variety of perspectives (front view, top view, back view, left view, right view and bottom view) (see Fig. 4). The user can also select a different shape from the available options. In projection modules, users could view objects in different planes and visualize them from various perspectives (see Figs. 3, 4). Users were instructed to follow self-paced learning for 1 week and explore all functions available in various modules in the given time. This application was Android-based and students were suggested to use smartphones supporting Android 8 and above.
In developing the application, guiding principles were drawn from the Cognitive Theory of Multimedia Learning (CTML) proposed by Mayer (2014). This theory, deeply embedded in cognitive science, offers insights into the mechanisms by which the human brain assimilates information from multimedia instructional messages. The relevance of CTML in designing AR applications, particularly in educational contexts, has been emphasized by Sommerauer and Müller (2014). Their advocacy underlines the theory's utility in tailoring AR experiences in our study to align with learners' cognitive processes. The AR application in our study was developed by incorporating distinct principles of multimedia learning. Specifically, we integrated: (a) the multimedia principle, emphasizing enhanced learning from a combination of text and visuals over text alone; (b) the coherence principle, ensuring the exclusion of extraneous materials not pertinent to the subject matter; (c) the redundancy principle, highlighting the effectiveness of learning from graphics and narration over a combination of graphics, narration, and on-screen text; (d) the signaling principle, which focuses on drawing learners' attention to crucial elements for improved learning; and (e) the segmenting principle, advocating for the breakdown of complex topics into manageable subtopics for better comprehension., 4). Users were instructed to follow self-paced learning for 1 week and explore all functions available in various modules in the given time. This application was Android-based and students were suggested to use smartphones supporting Android 8 and above.
Instruments
Pre-test and post-test
The researchers constructed pre-tests and post-tests to assess the student’s learning performance in the control group (CG) and the experimental group (EG). These tests were used to assess the ED knowledge of students. We ensured that questions in the test were relevant to the course material. Both the pretest and posttest were comprised of 20 multiple-choice questions and a group of five domain experts were consulted for the validation of the test items. The standard of questions in the pre-test and the post-test were similar (see Fig. 5). The overall Cronbach’s α values for both the pre-test and post-test were above 0.7, which is acceptable (Barrett, 2001). Students in each group were given a maximum of 30 min to complete the pre-test and post-test.
Revised purdue spatial visualization tests: visualization of rotations (Revised PSVT: R)
The Revised Purdue Spatial Visualization Tests: Visualization of Rotations (Revised PSVT: R) (Yoon, 2011) is an updated version of PSVT: R (Bodner & Guay, 1997). The Revised PSVT: R is a tool for measuring spatial visualization ability in three-dimensional mental rotation in individuals over the age of 13. Maeda et al., (2013) used this test to assess the spatial ability of first-year undergraduate engineering students. Therefore, we found Revised PSVT-R suitable for our study. The psychometric tool has two practice questions and then 30 test questions. The test questions consisted of 13 symmetrical and 17 asymmetrical 2-D isometric drawings of 3-D objects. The participants were given a maximum of 25 min to complete the PSVT: R test.
In addition to these instruments, we employed a questionnaire to get student feedback about their experience with EDINAR (see Appendix A).
Procedure
Figure 6 demonstrates the experimental procedure of the study. The experiment consists of three stages: (a) initially both groups were required to complete the PSVT-R test, and then they were asked to complete the pre-test within the allotted time, (b) students in the experimental group were instructed to use the EDINAR to study ED for a week, simultaneously students in the control group were asked to study ED using conventional methods and (c) both groups were asked to complete the post-test. Thereafter, students in the experimental group were asked to give their feedback regarding the AR application they used to study ED.
Data analysis
Descriptive statistics and inferential statistics were used to analyze the collected data. We employed one-way ANOVA analysis to examine the differences in learning performance between the experimental group and the control group. Skewness and kurtosis were computed to test the data's normality. All the variables' skewness and kurtosis values fall within the recommended ranges of |3| and |10|, respectively (Kline et al., 1999). All analyses were carried out using the Statistical Package for the Social Sciences, version 21 (SPSS 21).
Results
Learning performances
A one-way ANOVA was conducted on pretest scores to examine whether there was a significant difference in students’ knowledge of ED before the intervention. Similarly, we conducted a one-way ANOVA on post-test scores to evaluate whether there was a statistically significant difference in learning performance between groups after the intervention. The results of our study are shown in Table 3, which includes the means and standard deviations of the scores obtained by the groups on the pre-test and post-test. In the pretest, the mean value and standard deviation were 12.78 and 3.86 for the control group, and 12.80 and 4.04 for the experimental group, respectively. In the post-test, the mean value and standard deviation were 12.85 and 3.84 for the control group, and 18.07 and 3.24 for the experimental group, respectively. The findings show that there was no significant difference in pre-test scores between the control group and the experimental group, however, there was a significant difference in their post-test scores. (pre-test: F = 0.001, p > 0.05, post-test: F = 154.55, p < 0.05).
In addition, we also performed a one-way ANOVA on the control group and experimental group’s learning gains. The mean score and standard deviation of the control group were respectively 5.41 and 4.10. The experimental group had a mean score of 8.20 and a standard deviation of 4.97, respectively (see Table 4). The findings in Table 4 show that there was a substantial difference between the experimental group and the control group in terms of learning gain (F = 36.65, p < 0.05).
Students in both groups were assigned to different achievement levels based on their PSVT-R test scores (Bodner & Guay, 1997). Low achievers were students who received less than 10 marks in the PSVT-R test, average achievers were those who received equal to 10 marks in the test, and high achievers were those who received more than 10 marks in the test. Table 5 depicts the outcomes of the participants’ learning achievement based on the various achievement levels between the pre-test and post-test for both groups. We found that there were no significant differences in the pre-test performance of the students across the levels (high: F = 1.56, p > 0.05, average: F = 0.95, p > 0.05, low: F = 1.20, p > 0.05) (see Table 5). In contrast, there was a significant difference in post-test learning performance across the groups for all levels of students (high: F = 72.04, p < 0.05, average: F = 109.35, p < 0.05, low: F = 75.00, p < 0.05) (see Table 5). The experimental group’s high achievers had a mean and standard deviation of 17.23 and 4.77, whereas the control group’s high achievers had a mean and standard deviation of 12.21 and 4.40. The average achievers in the experimental group had a mean and standard deviation of 19.00 and 1.04, while the average achievers in the control group had a mean and standard deviation of 14.66 and 1.43. Low achievers in the experimental group had a mean score of 18.50 and a standard deviation of 3.07, whereas those in the control group had a score of 13.45 and a standard deviation of 2.73.
Students’ experience with AR technology in engineering drawing course
The qualitative feedback obtained from the experimental group is labelled into five categories (see Table 6). In the experimental group consisting of 196 students, it was noted that 71 students gave the application a rating of 4 out of 5, while 51 students awarded it the highest rating of 5 out of 5 (see Fig. 7). It was also found that very few students were not happy with the application as shown by their rating. Students stated that EDINAR may serve as a suitable substitute for AutoCAD in laboratory classes as well. A significant number of students believed that, as a result of EDINAR, they were better able to visualize complex concepts of the ED course.
Although some of the students reported having trouble using EDINAR’s functions and disliked its user interface, a great number of students liked the application and were able to finish all the topics without difficulty. A small number of students believed that EDINAR did not properly explain certain concepts, such as the cross-sections of solids and planes. Students stated that the application is helpful for first-year undergraduates who will be studying ED for the first time. They also agreed that teachers could also use this application to teach ED in the classroom. According to students, EDINAR would be valuable for undergraduate students in the Civil Engineering and Mechanical Engineering departments. The majority of students expressed an interest in recommending EDINAR to their peers.
Discussion and conclusion
This study examined the effect of AR technology on students’ learning in an ED course as compared to conventional methods of studying ED. We developed an AR application and included the complex concepts taught that were identified in the pilot study related to the ED course. Three research questions were addressed in this study—the first one deals with the effectiveness of AR-assisted ED learning on the performance of the students. These outcomes can be attributed to the AR application's features that enabled users to visualize complex shapes and their cross-sectional components in 3-D form from various perspectives. The results revealed that in comparison to conventional methods, AR significantly improved students’ learning performance. This result is consistent with earlier research indicating that AR can improve learning outcomes (Ali et al., 2017a; Liou et al., 2016; Murthy et al., 2015). Engineering drawing often involves complex concepts and AR provides a visual representation with the multi-sensory experience of these 3-dimensional concepts, making it easier for students to understand and retain information (Ali et al., 2017a). In addition, AR facilitates active learning, where students are more directly involved in the learning process, leading to improved performance (Adi et al., 2022).
The second research question investigated whether there were statistically significant differences between the experimental and control groups in terms of students’ performance with varying achievement levels (based on PSVT-R scores). In the post-test, it was observed that the experimental group did better than the control group, and this was true regardless of the achievement levels of either group. The simplification of complex ED course content into 3-D forms with improved visualization and features such as rotation and zoom in the AR application facilitated students of varying spatial abilities to achieve better results in the post-test. The high achievers in the experimental group did significantly better than those in the control group. This result is in line with past research indicating that AR can enhance the learning of students of all achievement levels (Bhagat et al., 2021).
In the last research question, we analysed the feedback received from the students to determine their perspective and application of AR in education. Students agreed that AR-assisted learning is useful for courses that cover complex topics, such as ED. Over half of the students found satisfaction in the engaging and interactive aspects of the AR application, as evidenced by the ratings they gave. This aligns with findings from prior studies (Dünser et al., 2012; Tombi & Rambli, 2013). Some students encountered difficulties in positioning their devices correctly with the markers to accurately display the 3-D models on the screen. This is a commonly encountered drawback experienced by users of marker-based AR applications (KB & Patil, 2020). Students’ feedback indicated a significant increase in their visualization because of the use of augmented reality in their learning, which was supported by prior research (Martin et al., 2015). The projection of points and lines in different planes and quadrants is one of those difficult topics that have been simplified by using AR. Students noted that the AR application was beneficial in learning the projection of points and lines, an aspect they found challenging to grasp in the traditional classroom setting. Additionally, the AR technology more effectively demonstrated orthographic projection, the projection of solids, and their cross-sectional parts, as reflected in their feedback. Feedback from students indicated that breaking down complex topics of ED into subtopics made it easier for them to grasp the content. The predominance of 3-D images over text in the AR application further clarified their understanding. Additionally, they noted the minimal repetition of content within the application, aiding them in concentrating more effectively on pertinent material. These results are consistent with prior research findings (Bhagat et al., 2021; Zambri & Kamaruzaman, 2020).
Limitations and future work
The study has some limitations. First, the students were not permitted to draw while using the EDINAR. They could only explore the shapes and features provided in the application. Second, EDINAR lack a feature that allows students to create customized structures like pipes, buildings etc. using the basic shapes that were available in the application. Third, EDINAR is available only for Android users and not for iOS users. Another limitation of the study was the disproportionate inclusion of fewer female participants compared to a larger number of male participants, which could have introduced bias into the research findings. While acknowledging the benefits of using AR in the context of an ED course, it's important to recognize that it cannot replace the hands-on experience, which is a crucial aspect of learning in ED courses. In future, we intend to incorporate an assessment experience into our application so that teachers can utilize it as an interactive assessment tool for an engineering drawing course. The application also requires a feature that enables tracking of usage and collection of log data.
We also aim to include a mechanism in our application that would allow students to construct shapes with varied dimensions based on their requirements. Including the features listed above in our application would make it more dynamic, allowing students to learn ED topics more effectively. Additionally, we aim to explore various other media forms for teaching ED, which could be evaluated alongside AR for the ED course. This expansion is motivated by the fact that in this study, the traditional content for the ED course was limited to text and image-based slides. Finally, in order to provide users with more time to learn the course using our application, we will lengthen the intervention period.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author upon reasonable request.
Notes
References
AdiBadiozaman, I. F., Segar, A. R., & Hii, J. (2022). A pilot evaluation of technology–enabled active learning through a hybrid augmented and virtual reality app. Innovations in Education and Teaching International, 59(5), 586–596. https://doi.org/10.1080/14703297.2021.1899034
Ali, D. F., Omar, M., Ibrahim, N. H., Surif, J., Ali, M., & Ismail, S. (2017a). Overcoming the problems faced by students in learning engineering drawing with the implementation of an augmented reality learning environment. Man in India, 97(17), 147–159.
Ali, D. F., Omar, M., Mokhtar, M., Suhairom, N., Abdullah, A. H., & Halim, N. (2017b). A review on augmented reality application in engineering drawing classrooms. Man in India, 97(19), 195–204.
Ali, D. F., Omar, M., Sunar, M. S., Zaid, N. M., Ibrahim, N. H., Surif, J. (2022). AREDAPPS: Mobile augmented reality development and learning framework based on augmented reality technology for engineering drawing course. In: Lv, Z., Song, H. (eds) Intelligent Technologies for Interactive Entertainment. INTETAIN 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 429. Springer, Cham. https://doi.org/10.1007/978-3-030-99188-3_20
Ariffin, A., Samsudin, M., Zain, A. M., Hamzah, N., & Subramaniam, T. (2017). Integrating animation and graphics in problem-based learning to improve students' achievement in engineering drawing courses. In 2017 7th World engineering education forum (weef) (pp. 732–738). https://doi.org/10.1109/WEEF.2017.8467087
Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators & Virtual Environments, 6(4), 355–385. https://doi.org/10.1162/pres.1997.6.4.355
Bao, Z., Zhao, X., & Li, S. (2020). Problems in the teaching of “Engineering Drawing” and measures to improve the teaching effect. https://doi.org/10.38007/Proceedings.0000940
Baronio, G., Motyl, B., & Paderno, D. (2016). Technical drawing learning tool-level 2: An interactive self-learning tool for teaching manufacturing dimensioning. Computer Applications in Engineering Education, 24(4), 519–528. https://doi.org/10.1002/cae.21728
Barrett, P. (2001). Assessing the reliability of rating data.
Bhagat, K. K., Yang, F.-Y., Cheng, C.-H., Zhang, Y., & Liou, W.-K. (2021). Tracking the process and motivation of math learning with augmented reality. Educational Technology Research and Development, 69(6), 3153–3178. https://doi.org/10.1007/s11423-021-10066-9
Bin Nordin, M. S., Bin Subari, K., Bin Abdul Hamid, M. Z., et al. (2013). Visualization skills and learning style patterns among engineering students at universiti teknologi Malaysia. Procedia-Social and Behavioral Sciences, 93, 1769–1775. https://doi.org/10.1016/j.sbspro.2013.10.114
Bodner, G. M., & Guay, R. B. (1997). The Purdue visualization of rotations test. The Chemical Educator, 2(4), 1–17. https://doi.org/10.1007/s00897970138a
Brito, P. Q., & Stoyanova, J. (2018). Marker versus markerless augmented reality. Which has more impact on users? International Journal of Human–Computer Interaction, 34(9), 819–833. https://doi.org/10.1080/10447318.2017.1393974
Camba, J., Contero, M., & Salvador-Herranz, G. (2014). Desktop vs. mobile: A comparative study of augmented reality systems for engineering visualizations in education. In 2014 IEEE Frontiers in education conference (FIE) proceedings (pp. 1–8). IEEE. https://doi.org/10.1109/FIE.2014.7044138
Chang, C.-H. (2012). Apply discovery teaching model to instruct engineering drawing course: Sketch a regular pentagon. Procedia-Social and Behavioral Sciences, 64, 457–466. https://doi.org/10.1016/j.sbspro.2012.11.054
Cheng, J. C., Chen, K., & Chen, W. (2017). Comparison of marker-based AR and markerless AR: A case study on indoor decoration system. In Lean and Computing in Construction Congress (LC3): Proceedings of the Joint Conference on Computing in Construction (JC3) (pp. 483–490). https://doi.org/10.24928/JC3-2017%2F0231
Chin, K. Y., Wang, C. S., & Chen, Y. L. (2019). Effects of an augmented reality-based mobile system on students’ learning achievements and motivation for a liberal arts course. Interactive Learning Environments, 27(7), 927–941. https://doi.org/10.1080/10494820.2018.1504308
Contero, M., Gomis, J. M., Naya, F., Albert, F., & Martin-Gutierrez, J. (2012). Development of an augmented reality-based remedial course to improve the spatial ability of engineering students. In 2012 Frontiers in education conference proceedings (pp. 1–5). IEEE. https://doi.org/10.1109/FIE.2012.6462312
DanakornNincarean, A., Phon, L. E., Rahman, M. H. A., Utama, N. I., Ali, M. B., Abdi Halim, N. D., & Kasim, S. (2019). The effect of augmented reality on spatial visualization ability of elementary school students. International Journal on Advanced Science Engineering Information Technology, 9(2), 624–629. https://doi.org/10.18517/ijaseit.8.5.4971
de Vere, I., Kapoor, A., Melles, G., et al. (2011). Developing a drawing culture: New directions in engineering education. In Ds 68–8: Proceedings of the 18th international conference on engineering design (iced 11), impacting society through engineering design, vol. 8: Design education, lyngby/copenhagen, Denmark, 15.-19.08. 2011 (pp. 226–235). https://api.semanticscholar.org/CorpusID:55902153
Dorribo-Camba, J., & Contero, M. (2013). Incorporating augmented reality content in engineering design graphics materials. In 2013 IEEE Frontiers in education conference (FIE) (pp. 35–40). IEEE. https://doi.org/10.1109/FIE.2013.6684784
Dunleavy, M., Dede, C. (2014). Augmented reality teaching and learning. In: Spector, J., Merrill, M., Elen, J., Bishop, M. (eds) Handbook of research on educational communications and technology. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3185-5_59
Dünser, A., Steinbügl, K., Kaufmann, H., & Glück, J. (2006). Virtual and augmented reality as spatial ability training tools. In Proceedings of the 7th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCI (pp. 125–132). https://doi.org/10.1145/1152760.1152776
Dünser, A., Walker, L., Horner, H., & Bentall, D. (2012). Creating interactive physics education books with augmented reality. In Proceedings of the 24th Australian computer–human interaction conference (pp. 107–114). https://doi.org/10.1145/2414536.2414554
Edwards-Stewart, A., Hoyt, T., & Reger, G. (2016). Classifying different types of augmented reality technology. Annual Review of CyberTherapy and Telemedicine, 14, 199–202.
Garland, N. P., Glithro, R., & Wade, R. (2017). The challenges facing education in engineering drawing practice. In Proceedings of the 19th international conference on engineering and product design education (E&PDE17) (pp. 254–259). https://api.semanticscholar.org/CorpusID:54037352
Garzón, J., Pavón, J., & Baldiris, S. (2019). Systematic review and meta-analysis of augmented reality in educational settings. Virtual Reality, 23, 447–459. https://doi.org/10.1007/s10055-019-00379-9
HaghshenasGorgani, H., & Jahantigh-Pak, A. (2020). A new method for assessment of engineering drawing answer scripts using fuzzy logic. Journal of Computational Applied Mechanics, 51(1), 170–183. https://doi.org/10.22059/jcamech.2019.265225.325
Jianqing, M., & Zibin, X. (2015). Discussion on engineering drawing course teaching reform for excellent engineer training. In 2015 7th International conference on information technology in medicine and education (itme) (pp. 448–451). https://doi.org/10.1109/ITME.2015.106
KB, A., & Patil, P. N. (2020). Tracking methods in augmented reality–explore the usage of marker-based tracking. In Proceedings of the 2nd international conference on IoT, social, mobile, analytics & cloud in computational vision & bio-engineering (ISMAC-CVB 2020). https://doi.org/10.2139/ssrn.3734851
Kline, R. B., & Santor, D. A. (1999). Principles and practice of structural equation modelling. Canadian Psychology, 40(4), 381. ISBN 9781462551910
Kösas, T., & Karakus¸, F. (2018). The effects of computer-aided design software on engineering students’ spatial visualization skills. European Journal of Engineering Education, 43(2), 296–308. https://doi.org/10.1080/03043797.2017.1370578
Lagenbach, J., Wächter, M., Lohrengel, A., & Müller, N. (2015). teaching engineering drawing in a technology-changing environment. In DS 82: Proceedings of the 17th international conference on engineering and product design education (E&PDE15), great expectations: Design teaching, research & enterprise, Loughborough, UK, 03-04.09. 2015 (pp. 162–167). https://api.semanticscholar.org/CorpusID:96452022
Lampropoulos, G., Keramopoulos, E., Diamantaras, K., & Evangelidis, G. (2022). Augmented reality and gamification in education: A systematic literature review of research, applications, and empirical studies. Applied Sciences, 12(13), 6809. https://doi.org/10.3390/app12136809
Lanzotti, A., Calise, M., Molaro, M., Papa, S., Patalano, S., & Renno, F. (2019). ‘Federica’s mooc’ (massive open online course): A blended course in engineering drawing at federico ii. International Journal on Interactive Design and Manufacturing (IJIDeM), 13(3), 1115–1128. https://doi.org/10.1007/s12008-019-00575-6
Lee, K. (2012). Augmented reality in education and training. TechTrends, 56(2), 13–21. https://doi.org/10.1007/s11528-012-0559-3
Liang, C., Lingling, W., Ruiqiu, Z., Wei, X., & Zhinan, Q. (2018). The teaching reform and practice of engineering drawing based on the system engineering. Journal of Graphics, 39(6), 1214.
Lin, W.-L., Tsai, P.-H., Lin, H.-Y., & Chen, H.-C. (2014). How does emotion influence different creative performances? The mediating role of cognitive flexibility. Cognition & Emotion, 28(5), 834–844. https://doi.org/10.1080/02699931.2013.854195
Liou, W. K., Bhagat, K. K., & Chang, C. Y. (2016). Beyond the flipped classroom: A highly interactive cloud-classroom (HIC) embedded into basic materials science courses. Journal of Science Education and Technology, 25, 460–473. https://doi.org/10.1007/s10956-016-9606-8
Maeda, Y., Yoon, S. Y., Kim-Kang, G., & Imbrie, P. (2013). Psychometric properties of the revised psvt: R for measuring first-year engineering students’ spatial ability. International Journal of Engineering Education, 29(3), 763–776.
Martín-Gutiérrez, J., Contero, M., & Alcañiz, M. (2015). Augmented reality to training spatial skills. Procedia Computer Science, 77, 33–39. https://doi.org/10.1016/j.procs.2015.12.356
Martín-Gutiérrez, J., Guinters, E., & Perez-Lopez, D. (2012). Improving strategy of self-learning in engineering: Laboratories with augmented reality. Procedia-Social and Behavioral Sciences, 51, 832–839. https://doi.org/10.1016/j.sbspro.2012.08.249
Marunic, G., & Glazar, V. (2013). Spatial ability through engineering graphics education. International Journal of Technology and Design Education, 23(3), 703–715. https://doi.org/10.1007/s10798-012-9211-y
Mayer, R. E. (2014). Incorporating motivation into multimedia learning. Learning and Instruction, 29, 171–173. https://doi.org/10.1016/j.learninstruc.2013.04.003
Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12), 1321–1329.
Mingxia, Z. (2021). Innovative reform of engineering drawing course based on design project drive. In Journal of Physics: Conference Series (Vol. 1738, No. 1, p. 012100). IOP Publishing. https://doi.org/10.1088/1742-6596/1738/1/012100
Mu, H., Xue, L., Xue, Y., & Wang, J. (2021). Discussion on” online hybrid” teaching of engineering drawing course under the background of epidemic situation. In 2021 10th international conference on educational and information technology (iceit) (pp. 76–82). https://doi.org/10.1109/ICEIT51700.2021.9375557
Mu, H., Xue, Y., Xue, L., & Wang, X. (2022). Discussion on the cultivation of innovation ability in engineering drawing teaching under the background of “emerging engineering education”. In 2022 10th International Conference on information and education technology (ICIET) (pp. 250–256). https://doi.org/10.1109/ICIET55102.2022.9779043
Mujiarto, M., Komaro, M., Pertiwi, A. S., & Muhammad, T. (2019). The development of multimedia engineering drawing animations for increasing vocational high school students competency in Indonesia. In 5th UPI International conference on technical and vocational education and training (ICTVET 2018) (pp. 313–315). Atlantis Press. https://doi.org/10.2991/ictvet-18.2019.71
Murthy, M., Babu, K. M., Jebaraj, P. M., Maddinapudi, L. R., Sunkari, V., & Reddy, D. V. (2015). Augmented reality as a tool for teaching a course on elements of engineering drawing. Journal of Engineering Education Transformations, 23(1), 295–297. https://doi.org/10.16920/jeet/2015/v0i0/59362
Olkun, S. (2003). Making connections: Improving spatial abilities with engineering drawing activities. International Journal of Mathematics Teaching and Learning, 3(1), 1–10. https://doi.org/10.1501/0003624
Omar, M., Ali, D. F., Nasir, A. N., & Sunar, M. S. (2019). AREDApps: Integrating mobile augmented reality in orthographic projection teaching and learning. International Journal of Recent Technology and Engineering, 8, 821–825.
Raffaeli, R., Cicconi, P., & Mandorli, F. (2019). A comparative assessment of learning outcomes in online vs traditional teaching of engineering drawing. In International workshop on higher education learning methodologies and technologies online (pp. 149–162). https://doi.org/10.1007/978-3-030-31284-8_12
Rafi, A., Samsudin, K. A., & Ismail, A. (2006). On improving spatial ability through computer-mediated engineering drawing instruction. Journal of Educational Technology & Society, 9(3), 149–159.
Rica, E., Moreno-Garc´ıa, C. F., A´ lvarez, S., & Serratosa, F. (2020). Reducing human effort. in engineering drawing validation. Computers in Industry, 117, 103198. https://doi.org/10.1016/j.compind.2020.103198
Sommerauer, P., & Müller, O. (2014). Augmented reality in informal learning environments: A field experiment in a mathematics exhibition. Computers & Education, 79, 59–68. https://doi.org/10.1016/j.compedu.2014.07.013
Serdar, T. (2016). Mixed reality tools in engineering drawing course. In 2016 ASEE annual conference and exposition.
Serdar, T., Aziz, E. S. S., Esche, S. K., & Chassapis, C. (2013). Integration of augmented reality into the CAD process. In 2013 ASEE annual conference and exposition (pp. 23–784). https://doi.org/10.18260/1-2-19798
Sharma, G., Murugadoss, J. R., & Rambabu, V. (2020). Fostering higher-order thinking skills in engineering drawing. Journal of Engineering Education Transformations, 34(1), 28–40.
Shreeshail, M., & Koti, C. (2016). Augmenting the out-of-classroom learning of machine drawing laboratory course. Journal of Engineering Education Transformations, 29(4), 37–41. https://doi.org/10.16920/jeet/2016/v29i4/90668
Shreeshail, M., Suresh, H., Gurupadayya-Hiremath, B. S., & BB, K. (2020). An attempt to impart engineering drawing standards through a problem-based learning approach. Journal of Engineering Education Transformations, 34(Special Issue). https://doi.org/10.16920/JEET%2F2021%2FV34I0%2F157146
Sorby, S., Casey, B., Veurink, N., & Dulaney, A. (2013). The role of spatial training in improving spatial and calculus performance in engineering students. Learning and Individual Differences, 26, 20–29. https://doi.org/10.1016/j.lindif.2013.03.010
Spiro, R. J., Collins, B. P., Thota, J. J., & Feltovich, P. J. (2003). Cognitive flexibility theory: Hypermedia for complex learning, adaptive knowledge application, and experience acceleration. Educational Technology, 43(5), 5–10.
Szeto, E., & Cheng, A. Y. (2016). Towards a framework of interactions in a blended synchronous learning environment: What effects are there on students’ social presence experience? Interactive Learning Environments, 24(3), 487–503. https://doi.org/10.1080/10494820.2014.881391
Thomas, P. C., & David, W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Hawaii international conference on system sciences (Vol. 2). https://doi.org/10.1109/HICSS.1992.183317
Tomi, A. B., & Rambli, D. R. A. (2013). An interactive mobile augmented reality magical playbook: Learning number with the thirsty crow. Procedia Computer Science, 25, 123–130. https://doi.org/10.1016/j.procs.2013.11.015
Tsutsumi, E. (2004). A mental cutting test using drawings of intersections. Journal for Geometry and Graphics, 8(1), 117–126.
Tumkor, S., & de Vries, R. H. (2015). Enhancing spatial visualization skills in engineering drawing courses. In 2015 asee annual conference & exposition (pp. 26–663). https://doi.org/10.18260/p.24001
Violante, M. G., & Vezzetti, E. (2015). Design of web-based interactive 3d concept maps: A preliminary study for an engineering drawing course. Computer Applications in Engineering Education, 23(3), 403–411. https://doi.org/10.1002/cae.21610
Wang, Y., Ma, J., Kremer, G. E., & Jackson, K. L. (2019). An investigation of effectiveness differences between in-class and online learning: An engineering drawing case study. International Journal on Interactive Design and Manufacturing (IJIDeM), 13(1), 89–98. https://doi.org/10.1007/s12008-018-0510-8
Widayana, G., Rohman, M., Sulaiman, M., & Ratnawati, D. (2020). The Effectiveness of Interactive Multimedia-based Learning in Engineering Drawing Courses. Int. J. Innov. Creat. Chang. www. ijicc. net, 14(5), 2020.
Wu, H.-K., Lee, S.W.-Y., Chang, H.-Y., & Liang, J.-C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & Education, 62, 41–49. https://doi.org/10.1016/j.compedu.2012.10.024
Yasin, R. M., Halim, L., & Ishar, A. (2012). Effects of problem-solving strategies in the teaching and learning of engineering drawing subject. Asian Social Science, 8(16), 65. https://doi.org/10.5539/ass.v8n16p65
Yoon, S. Y. (2011). Psychometric properties of the revised Purdue spatial visualization tests: Visualization of rotations (the revised psvt:r).
Zambri, A. A., & Kamaruzaman, M. F. (2020). The integration of augmented reality (AR) in learning environment. In 2020 Sixth international conference on e-Learning (econf) (pp. 194–198). IEEE. https://doi.org/10.1109/econf51404.2020.9385487
Zhang, Y. X., Cheng, J. Q., Wang, J. Y., & Zhao, L. (2021). Co-assemble: A collaborative ar cross-devices teaching system for assemble practice courses. In 2021 IEEE conference on virtual reality and 3d user interfaces abstracts and workshops (vrw) (pp. 512–513). https://doi.org/10.1109/VRW52623.2021.00138
Acknowledgements
Not applicable.
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
AST, KKB: conceptualization; AST, KKB: methodology, formal analysis, investigation, data collection, data curation, writing original draft; AST, KKB, GL: writing – review & editing; KKB: funding acquisition. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study complied with all the ethical guidelines for surveys with human participants. All participants were informed of the purpose and procedures beforehand, and asked to submit written informed consent. They were free to quit at any time.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A: Open ended questions
Appendix A: Open ended questions
-
1.
Do you have any previous experience of using AR app? (Yes, No)
-
2.
How much would you rate the EDINAR? (1,2,3,4,5)
-
3.
Did you find the EDINAR useful? (Yes, No, Maybe)
-
4.
What did you like about the EDINAR?
-
5.
What are the difficulties you faced with the functions of EDINAR?
-
6.
What can we do to improve the User Interface of EDINAR?
-
7.
Any suggestions about the overall App that needs to be improved?
-
8.
What goals or benefits are you seeking through the use of EDINAR?
-
9.
Would you like to motivate your friends to use EDINAR? If yes/no, why?
-
10.
Do you have anything else you would like to share about EDINAR?
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tiwari, A.S., Bhagat, K.K. & Lampropoulos, G. Designing and evaluating an augmented reality system for an engineering drawing course. Smart Learn. Environ. 11, 1 (2024). https://doi.org/10.1186/s40561-023-00289-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s40561-023-00289-z