TY - GEN
T1 - Identifying and predicting the states of complex search tasks
AU - Liu, Jiqun
AU - Sarkar, Shawon
AU - Shah, Chirag
PY - 2020/3/14
Y1 - 2020/3/14
N2 - Complex search tasks that involve uncertain solution space and multi-round search iterations are integral to everyday life and information-intensive workplace practices, affecting how people learn, work, and resolve problematic situations. However, current search systems still face plenty of challenges when applied in supporting users engaging in complex search tasks. To address this issue, we seek to explore the dynamic nature of complex search tasks from process-oriented perspective by identifying and predicting implicit task states. Specifically, based upon the Web search logs and user annotation data (regarding information seeking intentions in local search steps, in-situ search problems, and help needed) collected from 132 search sessions in two controlled lab studies, we developed two task state frameworks based on intention state and problem-help state respectively and examined the connection between task states and search behaviors. We report that (1) complex search tasks of different types can be deconstructed and disambiguated based on the associated nonlinear state transition patterns; and (2) the identified task states that cover multiple subtle factors of user cognition can be predicted from search behavioral signals using supervised learning algorithms. This study reveals the way in which complex search tasks are unfolded and manifested in users' search interactions and paves the way for developing state-aware adaptive search supports and system evaluation frameworks.
AB - Complex search tasks that involve uncertain solution space and multi-round search iterations are integral to everyday life and information-intensive workplace practices, affecting how people learn, work, and resolve problematic situations. However, current search systems still face plenty of challenges when applied in supporting users engaging in complex search tasks. To address this issue, we seek to explore the dynamic nature of complex search tasks from process-oriented perspective by identifying and predicting implicit task states. Specifically, based upon the Web search logs and user annotation data (regarding information seeking intentions in local search steps, in-situ search problems, and help needed) collected from 132 search sessions in two controlled lab studies, we developed two task state frameworks based on intention state and problem-help state respectively and examined the connection between task states and search behaviors. We report that (1) complex search tasks of different types can be deconstructed and disambiguated based on the associated nonlinear state transition patterns; and (2) the identified task states that cover multiple subtle factors of user cognition can be predicted from search behavioral signals using supervised learning algorithms. This study reveals the way in which complex search tasks are unfolded and manifested in users' search interactions and paves the way for developing state-aware adaptive search supports and system evaluation frameworks.
KW - Complex search task
KW - Interactive ir
KW - Task state
UR - http://www.scopus.com/inward/record.url?scp=85082505921&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85082505921&partnerID=8YFLogxK
U2 - 10.1145/3343413.3377976
DO - 10.1145/3343413.3377976
M3 - Conference contribution
T3 - CHIIR 2020 - Proceedings of the 2020 Conference on Human Information Interaction and Retrieval
SP - 193
EP - 202
BT - CHIIR 2020 - Proceedings of the 2020 Conference on Human Information Interaction and Retrieval
PB - Association for Computing Machinery, Inc
T2 - 5th ACM SIGIR Conference on Human Information Interaction and Retrieval, CHIIR 2020
Y2 - 14 March 2020 through 18 March 2020
ER -