Skip to main content

Table 3 Species identification success metrics for various choices of characters used to calibrate the classifier

From: Species determination using AI machine-learning algorithms: Hebeloma as a case study

 

Testing set

Metrics (/100)

Character group

size (n)

Top 1

Top 3

Top 5

MRR

F1m

CG1

790

57.3

84.4

92.9

72.1

48.6

CG2

779

66.5

91.8

95.5

79.2

63.2

CG3

678

63.6

91.4

96.2

77.7

57.7

CG4

685

73.3

94.9

97.7

84.2

72.3

CG5

671

74.1

94.9

99.3

84.8

68.5

CG6

671

75.4

94.8

98.5

85.4

70.2

CG7

671

75.0

95.4

98.8

85.2

72.4

CG8

528

76.7

95.8

99.2

86.5

72.1

CG9

469

73.6

94.5

98.5

84.3

69.1

  1. In these results, neither the continent filter nor second pass is applied, and collections without recorded data for at most one character are permitted. The optimization method is AdamW and the network shape is one hidden layer with a ReLU activation function. In this and subsequent results tables, the final five columns refer to the Top 1, Top 3, Top 5, Mean Reciprocal Rank and macro F1 metrics respectively, all scaled to give a score out of 100, which would represent perfect prediction