• Developing section-level and bullet-level evaluation pipelines using ROUGE, BERTScore, and bipartite matching to compare system outputs against reference reports.
• Analyzing how well generated SITREPs preserve critical crisis information across structured report sections.

• Supported corpus collection and preprocessing pipelines, emphasizing consistent unit definitions and annotation-ready formatting.
• Assisted in annotation design and QA routines to improve label clarity and reduce ambiguity in training data.

• Designed prompt suites and rubric-based evaluations for groundedness/hallucination, with failure-mode categories tied to discourse phenomena, such as attribution, consistency, and hedging.
• Developed annotation guidelines to assess socio-cultural bias and pragmatic harm, emphasizing appropriateness in Korean register and stance.
• Validated a Korean multimodal dialogue dataset by aligning utterance-level pragmatic functions, such as agreement, refusal, and hesitation, with nonverbal cue labels.

Key insight: many reliability issues are not isolated “wrong facts,” but emerge from how meaning is constructed across turns, including implicature, underspecification, and discourse coherence.

• Created semantics-informed risk probes for single-turn inputs, including cases where meaning depends on polysemy or indirect phrasing.
• Developed multi-turn scenarios to capture escalation patterns, such as justification, concretization, and actionable requests, and measured how risk accumulates over dialogue context.
• Analyzed evasion behaviors after refusals, such as repair, paraphrase, and euphemisms, and incorporated these patterns into testing protocols.

Key insight: risk is often discourse-driven. What looks harmless in isolation can become unsafe when reference resolution, implicature, and turn-by-turn intent shifts are taken into account.

• Built a linguistically grounded ambiguity taxonomy, including ellipsis, anaphora, spacing/noise, and informal variants, to standardize how ambiguous inputs are handled.
• Applied text normalization and preprocessing guided by the taxonomy to reduce interpretation noise and improve NLU robustness.
• Led annotation efforts to ensure sociolinguistic coverage, including honorific levels, informal slang, and code-mixing, so the system behaves consistently across styles.

Key insight: in Korean conversational products, performance depends not only on intent classification accuracy but also on pragmatic consistency under register shifts.