
Peter BrusilovskyUniversity of Pittsburgh | Pitt · School of Computing and Information
Peter Brusilovsky
PhD
About
580
Publications
164,055
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
24,113
Citations
Citations since 2017
Introduction
*Looking for new PhD students to join the team* The focus of our work is developing adaptive Web-based systems that can provide highly personalized user support. Within Web personalization, I am mostly concerned with personalized E-Learning and adaptive information access. As a researcher, professor, and consultant, I have developed or co-developed a wide range of personalized systems over the last 30 years. A number of them can be accessed from my home page and the home page of PAWS group.
Additional affiliations
March 1996 - December 1997
November 1994 - March 1996
Publications
Publications (580)
Open student modeling (OSM) is an approach to technology-based learning, which makes student models available to the learners for exploration. OSM is known for its ability to increase student engagement, motivation, and knowledge reflection. A recent extension of OSM known as open social student modeling (OSSM) complements cognitive aspects of OSM...
This chapter offers an introduction to the emerging field of social information access. Social information access focuses on technologies that organize users past interaction with information in order to provide future users with better access to information. These technologies have become increasingly more popular in all areas of information acces...
Abstract Over the past decades, computer science educators have developed a multitude of interactive learning resources to support learning in various computer science domains, especially in introductory programming. While such smart content items are known to be beneficial, they are frequently offered through different login-based systems, each wi...
Springer International Publishing AG, part of Springer Nature 2018. Today, most people find what they are looking for online by using search engines such as Google, Bing, or Baidu. Modern web search engines have evolved from their roots in information retrieval to developing new ways to cope with the unique nature of web search. In this chapter, we...
“Social Navigation” for the Web has been created in response to the problem of disorientation in an information space. It helps users tackle the information overload challenge by visualizing the traces of behavior of other users and adding social affordances to the information space. Despite the popularity of the concept of social navigation, very...
Background
Skill integration is vital in students' mastery development and is especially prominent in developing code tracing skills which are foundational to programming, an increasingly important area in the current STEM education. However, instructional design to support skill integration in learning technologies has been limited.
Objectives
Th...
False information detection models are susceptible to adversarial attacks. Such susceptibility is a critical weakness of detection models. Automated creation of adversarial samples can ultimately help to augment training sets and create more robust detection models. However, automatically generated adversarial samples often do not preserve the info...
Knowledge Tracing (KT), which aims to model student knowledge level and predict their performance, is one of the most important applications of user modeling. Modern KT approaches model and maintain an up-to-date state of student knowledge over a set of course concepts according to students' historical performance in attempting the problems. Howeve...
Carousel-based recommendation interfaces allow users to explore recommended items in a structured, efficient, and visually-appealing way. This made them a de-facto standard approach to recommending items to end users in many real-life recommenders. In this work, we try to explain the efficiency of carousel recommenders using a carousel click model,...
Studies of technology-enhanced learning (TEL) environments indicated that learner behavior could be affected (positively or negatively) by presenting information about their peer groups, such as peer in-system performance or course grades. Researchers explained these findings by the social comparison theory, competition, or by categorizing them as...
The advancement of computational Artificial Intelligence (AI) in the recent decade has been transformative for many domains, including AI in Education. One direction, where it has caused a noticeable increase in research activity, is application of AI technologies to enhance digital textbooks by making them more interactive, engaging, adaptive, and...
One of the main directions of increasing the educational value of a digital textbook is its enrichment with interactive content. Such content can come from outside the textbooks - from multiple existing repositories of educational resources. However, finding the right place for such external resources is not always a trivial task. There exist multi...
One of the main directions of increasing the educational value of a digital textbook is its enrichment with interactive content. Such content can come from outside the textbooks - from multiple existing repositories of educational resources. However, finding the right place for such external resources is not always a trivial task. There exist multi...
False information detection models are susceptible to adversarial attacks. Such susceptibility is a critical weakness of detection models. Automated creation of adversarial samples can ultimately help to augment training sets and create more robust detection models. However, automatically generated adversarial samples often do not preserve the info...
Adaptive information access systems is one of the most popular
types of adaptive systems. It includes adaptive search, recommender
system, adaptive navigation support, and adaptive information
visualization. This is also one of the oldest types of adaptive systems
where the ideas of user control were explored. Motivated by a
timely selection of use...
The transition of textbooks from printed copies to digital and online formats has facilitated numerous attempts to enrich them with various kinds of interactive functionalities, link them with external resources or extract valuable information from them. As a result, new research challenges and opportunities emerge that call for the application of...
Carousel-based interfaces with multiple topic-focused item lists have emerged as a de-facto standard for presenting recommendation results to end-users in real-life recommender systems. In this paper, we attempt to formalize and explain the “magic” power of carousel-based interfaces from a traditional hypertext prospect of navigability. By applying...
We present here a novel instructional resource, called DeepCode, to support deep code comprehension and learning in intro-to-programming courses (CS1 and CS2). DeepCode is a set of instructional code examples which we call a codeset and which was annotated by our team with comments (e.g., explaining the logical steps of the underlying problem being...
Background
Patients and caregivers widely use online health communities (OHCs) to acquire knowledge from peers. Questions posed in OHCs reflect participants’ learning objectives and differ in their level of cognitive complexity. However, little is known about the topics and levels of participants’ learning objectives and the corresponding support t...
BACKGROUND
Patients and caregivers have been widely using Online Health Communities (OHCs) to acquire knowledge from peers. Questions posed in OHCs reflect the participant's learning objectives and are known to differ in the level of cognitive complexity. However, little is known about the topics and levels of participant learning objectives and th...
An interactive recommender system pursues two somewhat contradictory goals. On one hand, the system should provide highly relevant recommendations with the best match to the overall user needs. On the other hand, the recommendations should be sufficiently diverse to cover a range of users' possible interests. Such recommendations increase chances t...
Educational data mining research has demonstrated that the large volume of learning data collected by modern e-learning systems could be used to recognize student behavior patterns and group students into cohorts with similar behavior. However, few attempts have been done to connect and compare behavioral patterns with known dimensions of individua...
Online learning systems allow learners to freely access learning contents and record their interactions throughout their engagement with the content. By using data mining techniques on the student log data of those systems, it is possible to examine learning behavior and reveal navigation patterns through learning contents. This study was aimed at...
We present in this paper a summary analysis of log files collected during an experiment designed to test the hypothesis that prompting for free self-explanations leads to better comprehension of computer code examples. Indeed, the results indicate that students who were prompted to self-explain while trying to understand code examples performed sig...
The overarching goal of our project is to develop a recommender system that personalize online health-related materials to patients and their caregivers based on their needs and knowledge level. • The recommender system will address the knowledge discrepancy between patients and online health information, and accurately estimate the required knowle...
Ovarian cancer (OvCa) patients and caregivers have constant and evolving information needs. To meet their needs, they seek information from various resources, including online health information. Although about 60% of cancer patients are now using the Internet to meet their information needs, little is known about online health information seeking...
Using carousels to present recommendation results has been widely adapted for consumer-focused applications such as recommending movies and music. Carousel-based interfaces engage users in the recommendation process, leaving it to the user to decide which category of items is most relevant to them, yet leaving it to AI to produce a ranking of both...
BACKGROUND
Online health communities (OHCs) provide ovarian cancer (OvCa) patients, survivors, and their caregivers assistance beyond their traditional support channels. OvCa OHC promotes connection and exchange information among users who had similar experiences. This exchange of information often leads to resource sharing amongst users, as web li...
Background:
Online health communities (OHCs) provide ovarian cancer (OvCa) patients, survivors, and their caregivers with help beyond traditional support channels, such as health care providers and clinicians. OvCa OHCs promote connections and exchanges of information among users who have similar experiences. Users often exchange information, whic...
With the increased popularity of electronic textbooks, there is a growing interest in developing a new generation of “intelligent textbooks,” which have the ability to guide readers according to their learning goals and current knowledge. Intelligent textbooks extend regular textbooks by integrating machine-manipulable knowledge, and the most popul...
In recent years, researchers in the field of recommender systems have explored a range of advanced interfaces to improve user interactions with recommender systems. Some of the major research ideas explored in this new area include the explainability and controllability of recommendations. Controllability enables end users to participate in the rec...
This paper contributes to the research on explainable educational recommendations by investigating explainable recommendations in the context of personalized practice system for introductory Java programming. We present the design of two types of explanations to justify recommendation of next learning activity to practice. The value of these explai...
This paper presents our attempt to create an exploratory search system, PaperExplorer, for a historic archive of conference proceedings. PaperExplorer uses concept extraction, knowledge graphs, and user-controlled recommendation to assist users with various levels of domain expertise in their information needs.
Over the last 10 years, learning analytics have provided educators with both dashboards and tools to understand student behaviors within specific technological environments. However, there is a lack of work to support educators in making data-informed design decisions when designing a blended course and planning appropriate learning activities. In...
With the wide expansion of distributed learning environments the way we learn became more diverse than ever. This poses an opportunity to incorporate different data sources of learning traces that can offer broader insights into learner behavior and the intricacies of the learning process. We argue that combining analytics across different e-learni...
Purpose
Interest is currently growing in open social learner modeling (OSLM), which means making peer models and a learner's own model visible to encourage users in e-learning. The purpose of this study is to examine students' views about the OSLM in an e-learning system.
Design/methodology/approach
This case study was conducted with 40 undergradu...
Abstract Research has demonstrated that people generally think both their knowledge and performance levels are greater than they are. Although several studies have suggested that knowledge and progress visualization offered by open learner modeling (OLM) technology might influence students’ self-awareness in a positive way, insufficient evidence ex...
Ovarian cancer (OvCa) can be a deadly gynecological cancer affecting about 22k women per year in the United States with a significant recurrence rate [1]. Women with OvCa and their caregivers often seek support from online health communities (OHCs) [2]. These OHCs allow for the exchange of information and resources with other individuals who have h...
Finding research advisors is an important and challenging task for college students. On one hand, a research advisor that matches student interests and past preparation could fully engage the student with an exciting and productive research experience. On the other hand, students are frequently unable to formulate their interests and experience in...
Meeting other scholars at conferences is often a stochastic, intuition-driven process. Social recommender systems can support identifying new collaboration partners that one might not naturally choose. However, to boost the accumulation of social capital, such systems must be designed for diversifying social connections. This paper draws from the e...
In this paper, we introduce an approach that combines automatic domain knowledge modeling, student modeling, and content recommendation approaches to recommend relevant Wikipedia articles for students working with online electronic textbooks.
Previous research on technology-enhanced learning indicated that exposing students to information related to their peers’ performance might positively or negatively affect their behavior and performance. For example, recent research has demonstrated that augmenting traditional open learner models (OLMs) with views of the learner model of peers coul...
This paper presents our attempt to create an exploratory search system CovEx for a collection of academic papers related to COVID-19. CovEx uses concept extraction, knowledge graphs, and user-controlled recommendation to assist users with various levels of domain expertise in their information needs. CCS CONCEPTS • Information systems → Graph-based...
The increasing popularity of digital textbooks as a new learning media has resulted in a growing interest in developing a new generation of adaptive textbooks that can help readers to learn better through adapting to the readers’ learning goals and the current state of knowledge. These adaptive textbooks are most frequently powered by internal know...
Assessment plays a vital role in learning, as it provides both instructors and students with feedback on the overall effectiveness of their teaching or learning. However, when a student fails to correctly answer certain questions in an assessment (such as a quiz), the student needs specific recommendations that are tailored to their learning needs...
Over the last 10 years, the world experienced a rapid increase
in volume and diversity of digital learning resources. The abundance
of digital resources could support a range of powerful educational
scenarios, which were not available before. In this paper, we introduce a
novel approach that combines fully automatic knowledge modeling, student
mode...
This paper presents our attempt to create an exploratory search system CovEx for a collection of academic papers related to COVID-19. CovEx uses concept extraction, knowledge graphs, and user-controlled recommendation to assist users with various levels of domain expertise in their information needs. CCS CONCEPTS • Information systems → Graph-based...
Finding research advisors is an important and challenging task for college students. On one hand, a research advisor that matches student interests and past preparation could fully engage the student with an exciting and productive research experience. On the other hand, students are frequently unable to formulate their interests and experience in...
Behnam Rahdari [0000−0001−6514−912X] , Peter Brusilovsky [0000−0002−1902−1464] , Khushboo Thaker [0000−0003−3619−9376] , and Jordan Barria-Pineda [0000−0002−4961−4818] Abstract. In this paper, we introduce an approach that combines automatic domain knowledge modeling, student modeling, and content recommendation approaches to recommend relevant Wik...
Over the past two decades, several information exploration approaches were suggested to support a special category of search tasks known as exploratory search. These approaches creatively combined search, browsing, and information analysis steps shifting user efforts from recall (formulating a query) to recognition (i.e., selecting a link) and help...
This research is focused on how to support students’ acquisition of program construction skills through worked examples. Although examples have been consistently proven to be valuable for student’s learning, the learning technology for computer science education lacks program construction examples with interactive elements that could engage student...
With the increased popularity of electronic textbooks, there is a growing interests in developing a new generation of "intelligent textbooks", which have the ability to guide the readers according to their learning goals and current knowledge. The intelligent textbooks extend regular textbooks by integrating machine-manipulatable knowledge such as...
Recent studies have shown that students follow stable behav-ioral patterns while learning in online educational systems. These behavioral patterns can further be used to group the students into different clusters. However, as these clusters include both high-and low-performance students, the relation between the behavioral patterns and student perf...
Recommender system helps users to reduce information overload. In recent years, enhancing explainability in recommender systems has drawn more and more attention in the field of Human-Computer Interaction (HCI). However, it is not clear whether a user-preferred explanation interface can maintain the same level of performance while the users are exp...
In this work-in-progress paper, we presented a participatory process of designing explanation interfaces for a social recommender system with multiple explanatory goals. We went through four stages to identify the key components of the recommendation model, expert mental model, user mental model, and target mental model. We reported the results of...
The idea of self-improving intelligent educational systems is almost as old as the field of intelligent educational systems itself. The origin of this research stream could be traced to the paper of Tim O’Shea “A selfimproving quadratic tutor” (O'Shea, 1982), which was published 40 years ago in the famous special issue
of International Journal on t...
Tag clouds have been utilized as a “social” way to find and visualize information, providing both one-click access and a snapshot of the “aboutness” of a tagged collection. While many research projects have explored and compared various tag artifacts using information theory and simulations, fewer studies have been conducted to compare the effectiv...
As an interactive intelligent system, recommender systems are developed to give recommendations that match users' preferences. Since the emergence of recommender systems, a large majority of research focuses on objective accuracy criteria and less attention has been paid to how users interact with the system and the efficacy of interface designs fr...
Although many efforts are being made to provide educators with dashboards and tools to understand student behaviors within specific technological environments (learning analytics), there is a lack of work in supporting educators in making data-informed design decisions when designing a blended course and planning learning activities. In this paper,...
Recently, concatenating multiple keyphrases as a target sequence has been proposed as a new learning paradigm for keyphrase generation. Existing studies concatenate target keyphrases in different orders but no study has examined the effects of ordering on models' behavior. In this paper, we propose several orderings for concatenation and inspect th...
Information-seeking tasks with learning or investigative purposes are usually referred to as exploratory search. Exploratory search unfolds as a dynamic process where the user, amidst navigation, trial and error, and on-the-fly selections, gathers and organizes information (resources). A range of innovative interfaces with increased user control ha...
The beyond-relevance objectives of recommender systems have been drawing more and more attention. For example, a diversity-enhanced interface has been shown to associate positively with overall levels of user satisfaction. However, little is known about how users adopt diversity-enhanced interfaces to accomplish various real-world tasks. In this ar...
Researchers in many disciplines are developing novel interactive smart learning objects like exercises and visualizations. Meanwhile, Learning Management Systems (LMS) and eTextbook systems are also becoming more sophisticated in their ability to use standard protocols to make use of third party smart learning objects. But at this time, educational...
Recommending experts is an important challenge in many contexts. In this paper, we present a method to build a knowledge graph by integrating data from Google Scholar and Wikipedia to help students find a research advisor or thesis committee member. This knowledge graph is used to power the exploratory search interface to recommend similar keywords...
Recent studies of student problem-solving behavior have shown stable behavior patterns within student groups. In this work, we study patterns of student behavior in a richer self-organized practice context where student worked with a combination of problems to solve and worked examples to study. We model student behavior in the form of vectors of m...
Students might pursue different goals throughout their learning process. For example, they might be seeking new material to expand their current level of knowledge, repeating content of prior classes to prepare for an exam, or working on addressing their most recent misconceptions. Multiple potential goals require an adaptive e-learning system to r...
This paper outlines RSR, a relational social recommendation approach applied to a social graph comprised of relational entity profiles. RSR uses information extraction and learning methods to obtain relational facts about persons of interest from the Web, and generates an associative entity-relation social network from their extracted personal prof...
A hybrid recommender system fuses multiple data sources, usually with static and nonadjustable weightings, to deliver recommendations. One limitation of this approach is the problem to match user preference in all situations. In this paper, we present two user-controllable hybrid recommender interfaces, which offer a set of sliders to dynamically t...
The increasing utilization of massive open online courses has significantly expanded global access to formal education. Despite the technology's promising future, student interaction on MOOCs is still a relatively under-explored and poorly understood topic. This work proposes a multi-level pattern discovery through hierarchical discriminative tenso...
The purpose of this research is to study the possibility of identifying students, statistically, by analyzing their behavior in different consecutive activities. In this project, there are three different sorts of activities: animated example, basic example, and parameterized exercises. We extracted the behavior of each student from the log activit...
A hybrid recommender system fuses multiple data sources to deliver recommendations. One challenge of this approach is to match the changing user preferences with a list of static recommendations. In this paper, we present two user-controllable hybrid recommender interfaces, Relevance Tuner (for people recommendation) and Paper Tuner (for paper reco...
Recommendations for online educational systems generally differ from recommendations generated in other contexts (e.g. movies, e-commerce), given that students’ level of knowledge rather then their interests is key for suggesting the most appropriate content. Thus, the challenge of making recommendations more transparent is closely tied to how stud...
Hybrid social recommender systems use social relevance from multiple sources to recommend relevant items or people to users. To make hybrid recommendations more transparent and controllable, several researchers have explored interactive hybrid recommender interfaces, which allow for a user-driven fusion of recommendation sources. In this field of w...
We present Paper Tuner, a user-controlled interface for recommending papers and presentations at a research conference. The availability of multiple sources of information about user interests makes hybrid recommendation approach attractive in a conference context, but traditional static parallel hybridization makes is hard to generate a single ran...
Explainability is an important desired property of recommendation systems. We consider a graph-based recommendation approach, which generates detailed explanations to users in the form of labelled connecting relational paths and present a visualization interface intended to convey such detailed relational information in clear and intuitive manner....
In this demo paper, we present a visual approach for explaining learning content recommendation in the personalized practice system Mastery Grids. The proposed approach uses a concept-level visualization of student knowledge in Java programming to demonstrate why specific practice content is recommended by the system. The visualized student knowled...
Following the popularity of Wikipedia, community authoring systems are increasingly in use as content sharing outlets. As such, a Web-based portal for sharing of user-generated content (e.g., course notes, quiz answers, etc.) shows prospect to be a great tool for social E-Learning. Among others, students are expected to be active contributors in su...
A sizable body of research on instructional practices supports the use of worked examples for acquiring cognitive skills in domains such as mathematics and physics. Although examples are also important in the domain of programming, existing research on programming examples is limited. Program examples are used by instructors to achieve two importan...
Presents the introductory editorial for this issue of the publication.
As an interactive intelligent system, recommender systems are developed to give recommendations that match users' preferences. Since the emergence of recommender systems, a large majority of research focuses on objective accuracy criteria and less attention has been paid to how users interact with the system and the efficacy of interface designs fr...
Adaptive textbooks use student interaction data to infer the current state of student knowledge and recommend the most relevant learning materials. A challenge of student modeling for adaptive textbooks is that conventional student models are constructed based on performance data (quiz or problem-solving). However, students' interactions with onlin...
Questions
Question (1)
The link to the CovEx system reported in just shared paper
"CovEx: An Exploratory Search System for COVID-19 Scientific Literature" is here http://scythian.exp.sis.pitt.edu/covex/
Please, leave feedback for improving the system if you have a chance to try it.
Projects
Projects (19)
As the Internet has become a prominent source of health information to guide patients’ decision-making and self-management activities, patients strongly indicate they need navigational support to locate appropriate information on the Internet. The overall goal of our project is to build and implement a “Health E-Librarian with Personalized Recommendations (HELPeR)”, a personalized digital librarian that provides individualized, reliable online information relevant to the patient’s needs, interest and knowledge across the disease trajectory.






























![A basic problem in T3 requiring the component skill ‘a[i]’](profile/Yun-Huang-47/publication/365790639/figure/fig2/AS:11431281123524107@1677733343956/A-basic-problem-in-T3-requiring-the-component-skill-ai_Q320.jpg)















































![Figure 1. Adapted from the Anderson and Krathwohl taxonomy of learning [8].](profile/Yu-Chi-3/publication/361900569/figure/fig1/AS:11431281118518684@1675788946888/Adapted-from-the-Anderson-and-Krathwohl-taxonomy-of-learning-8_Q320.jpg)














































































































































































































