Graph-based Pattern-oriented, Context-sensitive Code Completion

Anh Tuan Nguyen, Tung Thanh Nguyen, Hoan Anh Nguyen, Ahmed Tamrawi, Hung Viet Nguyen, Jafar Al-Kofahi,
Tien N. Nguyen

Video Demo Downloads

Empirical Evaluation

 

In this section, we present our empirical evaluation on the accuracy and usefulness of GraPacc.We implemented GraPacc as an Eclipse's plug-in supporting code completion for Java programs. We do evaluation on both accuracy and usefulness of Grapacc.

The evaluation results show that, GraPacc can achieve up to 95% precision, 92% recall, and 93% f-score in code completion for automatic accuracy measurement. The result also shows that, with GraPacc, human subjects were more productive because GraPacc can help completing more code during programming. Their resulting code with GraPacc had higher quality and was less buggy.

  1. Experiment on accuracy of code completion
  2. Experiments on usefulness of code completion