Anydoc / anydoc parser engine (push) Canceled after 0s
App / Format, vet, test, and build (push) Canceled after 0s
CLI / test (macos-latest / go 1.26) (push) Canceled after 0s
CLI / test (ubuntu-latest / go 1.26) (push) Canceled after 0s
CLI / test (windows-latest / go 1.26) (push) Canceled after 0s
Build and Push Docker Image / build-ui (push) Canceled after 0s
Build and Push Docker Image / build-docreader (push) Canceled after 0s
Build and Push Docker Image / build-sandbox (push) Canceled after 0s
Build and Push Docker Image / build-app (amd64, linux/amd64, ubuntu-latest) (push) Canceled after 0s
Build and Push Docker Image / build-app (arm64, linux/arm64, ubuntu-24.04-arm) (push) Canceled after 0s
DocReader / Python tests and Go client tests (push) Canceled after 0s
Build & Publish (dsh-weknora) / Typecheck, test, pack (push) Canceled after 0s
Build & Publish (dsh-weknora) / End-to-end inside dsh (pinned) (push) Canceled after 0s
Build & Publish (dsh-weknora) / End-to-end inside dsh (latest, advisory) (push) Canceled after 0s
Frontend / Test, type-check, and build (push) Canceled after 0s
Go Lint Cache / warm lint cache (.) (push) Canceled after 0s
Go Lint Cache / warm lint cache (cli) (push) Canceled after 0s
Go Lint Cache / warm lint cache (client) (push) Canceled after 0s
Build & Publish (mcp-server) / Test (Python 3.10) (push) Canceled after 0s
Build & Publish (mcp-server) / Test (Python 3.11) (push) Canceled after 0s
Build & Publish (mcp-server) / Test (Python 3.12) (push) Canceled after 0s
Build & Publish (mcp-server) / Test (Python 3.13) (push) Canceled after 0s
Build and Push Docker Image / merge (push) Canceled after 0s
Build & Publish (dsh-weknora) / Publish to npm (push) Canceled after 0s
Build & Publish (mcp-server) / Build sdist + wheel (push) Canceled after 0s
Build & Publish (mcp-server) / Publish to PyPI (push) Canceled after 0s
42 lines
930 B
Go
42 lines
930 B
Go
package metric
|
|
|
|
import (
|
|
"github.com/Tencent/WeKnora/internal/types"
|
|
)
|
|
|
|
// RecallMetric calculates recall for retrieval evaluation
|
|
type RecallMetric struct{}
|
|
|
|
// NewRecallMetric creates a new RecallMetric instance
|
|
func NewRecallMetric() *RecallMetric {
|
|
return &RecallMetric{}
|
|
}
|
|
|
|
// Compute calculates the recall score
|
|
func (r *RecallMetric) Compute(metricInput *types.MetricInput) float64 {
|
|
// Get ground truth and predicted IDs
|
|
gts := metricInput.RetrievalGT
|
|
ids := metricInput.RetrievalIDs
|
|
|
|
// Convert ground truth to sets for efficient lookup
|
|
gtSets := SliceMap(gts, ToSet)
|
|
if len(gtSets) == 0 {
|
|
return 0.0
|
|
}
|
|
|
|
if len(ids) == 0 {
|
|
return 0.0
|
|
}
|
|
|
|
var totalRecall float64
|
|
for _, gtSet := range gtSets {
|
|
hits := Hit(ids, gtSet)
|
|
if len(gtSet) > 0 {
|
|
totalRecall += float64(hits) / float64(len(gtSet))
|
|
}
|
|
}
|
|
|
|
// Recall = average recall across all ground truth sets
|
|
return totalRecall / float64(len(gtSets))
|
|
}
|