This study aimed to investigate whether there was a significant difference in students' listening comprehension between those taught using the ELLLO application and those who were not, as well as how students' listening comprehension skills differed before and after the implementation of ELLLO for tenth-grade students at MAN 1 Pangkalpinang. The research employed a quasi-experimental design with a pretest and posttest control group, involving 71 tenth-grade students of MAN 1 Pangkalpinang. The participants were divided into two groups: 35 students in the experimental group and 36 in the control group. Both groups were given a pretest and posttest focusing on short functional texts to measure their listening comprehension skills. The data were analyzed using t-tests in SPSS 26. The statistical analysis showed that the mean posttest score for the experimental group was 64.23, while the control group scored 56.62. The mean difference between the two groups was 7.602, with a standard error of 3.269. The Sig. (2-tailed) value was 0.023, and t-obtained = 2.325, which was higher than the critical value of t-table = 1.997 at the 0.05 significance level with 65 degrees of freedom. Therefore, the null hypothesis (H₀) was rejected, and the alternative hypothesis (Hₐ) was accepted, indicating a significant difference in listening comprehension between students taught using the ELLLO application and those who were not. In conclusion, the use of ELLLO had a significant effect on improving students' listening comprehension.