Peter Brusilovsky

Peter Brusilovsky
University of Pittsburgh | Pitt · School of Computing and Information

PhD

About

580
Publications
164,055
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
24,113
Citations
Citations since 2017
148 Research Items
6612 Citations
201720182019202020212022202302004006008001,000
201720182019202020212022202302004006008001,000
201720182019202020212022202302004006008001,000
201720182019202020212022202302004006008001,000
Introduction
*Looking for new PhD students to join the team* The focus of our work is developing adaptive Web-based systems that can provide highly personalized user support. Within Web personalization, I am mostly concerned with personalized E-Learning and adaptive information access. As a researcher, professor, and consultant, I have developed or co-developed a wide range of personalized systems over the last 30 years. A number of them can be accessed from my home page and the home page of PAWS group.
Additional affiliations
March 1996 - December 1997
Carnegie Mellon University
Position
  • Visiting Researcher
November 1994 - March 1996
Universität Trier
Position
  • Alexander von Humboldt Fellow

Publications

Publications (580)
Article
Full-text available
Open student modeling (OSM) is an approach to technology-based learning, which makes student models available to the learners for exploration. OSM is known for its ability to increase student engagement, motivation, and knowledge reflection. A recent extension of OSM known as open social student modeling (OSSM) complements cognitive aspects of OSM...
Chapter
Full-text available
This chapter offers an introduction to the emerging field of social information access. Social information access focuses on technologies that organize users past interaction with information in order to provide future users with better access to information. These technologies have become increasingly more popular in all areas of information acces...
Article
Full-text available
Abstract Over the past decades, computer science educators have developed a multitude of interactive learning resources to support learning in various computer science domains, especially in introductory programming. While such smart content items are known to be beneficial, they are frequently offered through different login-based systems, each wi...
Book
Full-text available
Springer International Publishing AG, part of Springer Nature 2018. Today, most people find what they are looking for online by using search engines such as Google, Bing, or Baidu. Modern web search engines have evolved from their roots in information retrieval to developing new ways to cope with the unique nature of web search. In this chapter, we...
Article
“Social Navigation” for the Web has been created in response to the problem of disorientation in an information space. It helps users tackle the information overload challenge by visualizing the traces of behavior of other users and adding social affordances to the information space. Despite the popularity of the concept of social navigation, very...
Article
Full-text available
Background Skill integration is vital in students' mastery development and is especially prominent in developing code tracing skills which are foundational to programming, an increasingly important area in the current STEM education. However, instructional design to support skill integration in learning technologies has been limited. Objectives Th...
Conference Paper
Full-text available
False information detection models are susceptible to adversarial attacks. Such susceptibility is a critical weakness of detection models. Automated creation of adversarial samples can ultimately help to augment training sets and create more robust detection models. However, automatically generated adversarial samples often do not preserve the info...
Preprint
Full-text available
Knowledge Tracing (KT), which aims to model student knowledge level and predict their performance, is one of the most important applications of user modeling. Modern KT approaches model and maintain an up-to-date state of student knowledge over a set of course concepts according to students' historical performance in attempting the problems. Howeve...
Preprint
Full-text available
Carousel-based recommendation interfaces allow users to explore recommended items in a structured, efficient, and visually-appealing way. This made them a de-facto standard approach to recommending items to end users in many real-life recommenders. In this work, we try to explain the efficiency of carousel recommenders using a carousel click model,...
Chapter
Full-text available
Studies of technology-enhanced learning (TEL) environments indicated that learner behavior could be affected (positively or negatively) by presenting information about their peer groups, such as peer in-system performance or course grades. Researchers explained these findings by the social comparison theory, competition, or by categorizing them as...
Article
The advancement of computational Artificial Intelligence (AI) in the recent decade has been transformative for many domains, including AI in Education. One direction, where it has caused a noticeable increase in research activity, is application of AI technologies to enhance digital textbooks by making them more interactive, engaging, adaptive, and...
Conference Paper
Full-text available
One of the main directions of increasing the educational value of a digital textbook is its enrichment with interactive content. Such content can come from outside the textbooks - from multiple existing repositories of educational resources. However, finding the right place for such external resources is not always a trivial task. There exist multi...
Presentation
Full-text available
One of the main directions of increasing the educational value of a digital textbook is its enrichment with interactive content. Such content can come from outside the textbooks - from multiple existing repositories of educational resources. However, finding the right place for such external resources is not always a trivial task. There exist multi...
Preprint
Full-text available
False information detection models are susceptible to adversarial attacks. Such susceptibility is a critical weakness of detection models. Automated creation of adversarial samples can ultimately help to augment training sets and create more robust detection models. However, automatically generated adversarial samples often do not preserve the info...
Conference Paper
Full-text available
Adaptive information access systems is one of the most popular types of adaptive systems. It includes adaptive search, recommender system, adaptive navigation support, and adaptive information visualization. This is also one of the oldest types of adaptive systems where the ideas of user control were explored. Motivated by a timely selection of use...
Chapter
Full-text available
The transition of textbooks from printed copies to digital and online formats has facilitated numerous attempts to enrich them with various kinds of interactive functionalities, link them with external resources or extract valuable information from them. As a result, new research challenges and opportunities emerge that call for the application of...
Conference Paper
Full-text available
Carousel-based interfaces with multiple topic-focused item lists have emerged as a de-facto standard for presenting recommendation results to end-users in real-life recommender systems. In this paper, we attempt to formalize and explain the “magic” power of carousel-based interfaces from a traditional hypertext prospect of navigability. By applying...
Chapter
Full-text available
We present here a novel instructional resource, called DeepCode, to support deep code comprehension and learning in intro-to-programming courses (CS1 and CS2). DeepCode is a set of instructional code examples which we call a codeset and which was annotated by our team with comments (e.g., explaining the logical steps of the underlying problem being...
Article
Full-text available
Background Patients and caregivers widely use online health communities (OHCs) to acquire knowledge from peers. Questions posed in OHCs reflect participants’ learning objectives and differ in their level of cognitive complexity. However, little is known about the topics and levels of participants’ learning objectives and the corresponding support t...
Preprint
BACKGROUND Patients and caregivers have been widely using Online Health Communities (OHCs) to acquire knowledge from peers. Questions posed in OHCs reflect the participant's learning objectives and are known to differ in the level of cognitive complexity. However, little is known about the topics and levels of participant learning objectives and th...
Article
Full-text available
An interactive recommender system pursues two somewhat contradictory goals. On one hand, the system should provide highly relevant recommendations with the best match to the overall user needs. On the other hand, the recommendations should be sufficiently diverse to cover a range of users' possible interests. Such recommendations increase chances t...
Article
Full-text available
Educational data mining research has demonstrated that the large volume of learning data collected by modern e-learning systems could be used to recognize student behavior patterns and group students into cohorts with similar behavior. However, few attempts have been done to connect and compare behavioral patterns with known dimensions of individua...
Article
Online learning systems allow learners to freely access learning contents and record their interactions throughout their engagement with the content. By using data mining techniques on the student log data of those systems, it is possible to examine learning behavior and reveal navigation patterns through learning contents. This study was aimed at...
Conference Paper
Full-text available
We present in this paper a summary analysis of log files collected during an experiment designed to test the hypothesis that prompting for free self-explanations leads to better comprehension of computer code examples. Indeed, the results indicate that students who were prompted to self-explain while trying to understand code examples performed sig...
Poster
Full-text available
The overarching goal of our project is to develop a recommender system that personalize online health-related materials to patients and their caregivers based on their needs and knowledge level. • The recommender system will address the knowledge discrepancy between patients and online health information, and accurately estimate the required knowle...
Article
Full-text available
Ovarian cancer (OvCa) patients and caregivers have constant and evolving information needs. To meet their needs, they seek information from various resources, including online health information. Although about 60% of cancer patients are now using the Internet to meet their information needs, little is known about online health information seeking...
Conference Paper
Full-text available
Using carousels to present recommendation results has been widely adapted for consumer-focused applications such as recommending movies and music. Carousel-based interfaces engage users in the recommendation process, leaving it to the user to decide which category of items is most relevant to them, yet leaving it to AI to produce a ranking of both...
Preprint
BACKGROUND Online health communities (OHCs) provide ovarian cancer (OvCa) patients, survivors, and their caregivers assistance beyond their traditional support channels. OvCa OHC promotes connection and exchange information among users who had similar experiences. This exchange of information often leads to resource sharing amongst users, as web li...
Article
Background: Online health communities (OHCs) provide ovarian cancer (OvCa) patients, survivors, and their caregivers with help beyond traditional support channels, such as health care providers and clinicians. OvCa OHCs promote connections and exchanges of information among users who have similar experiences. Users often exchange information, whic...
Article
Full-text available
With the increased popularity of electronic textbooks, there is a growing interest in developing a new generation of “intelligent textbooks,” which have the ability to guide readers according to their learning goals and current knowledge. Intelligent textbooks extend regular textbooks by integrating machine-manipulable knowledge, and the most popul...
Article
Full-text available
In recent years, researchers in the field of recommender systems have explored a range of advanced interfaces to improve user interactions with recommender systems. Some of the major research ideas explored in this new area include the explainability and controllability of recommendations. Controllability enables end users to participate in the rec...
Chapter
This paper contributes to the research on explainable educational recommendations by investigating explainable recommendations in the context of personalized practice system for introductory Java programming. We present the design of two types of explanations to justify recommendation of next learning activity to practice. The value of these explai...
Conference Paper
Full-text available
This paper presents our attempt to create an exploratory search system, PaperExplorer, for a historic archive of conference proceedings. PaperExplorer uses concept extraction, knowledge graphs, and user-controlled recommendation to assist users with various levels of domain expertise in their information needs.
Article
Over the last 10 years, learning analytics have provided educators with both dashboards and tools to understand student behaviors within specific technological environments. However, there is a lack of work to support educators in making data-informed design decisions when designing a blended course and planning appropriate learning activities. In...
Article
With the wide expansion of distributed learning environments the way we learn became more diverse than ever. This poses an opportunity to incorporate different data sources of learning traces that can offer broader insights into learner behavior and the intricacies of the learning process. We argue that combining analytics across different e-learni...
Article
Purpose Interest is currently growing in open social learner modeling (OSLM), which means making peer models and a learner's own model visible to encourage users in e-learning. The purpose of this study is to examine students' views about the OSLM in an e-learning system. Design/methodology/approach This case study was conducted with 40 undergradu...
Article
Full-text available
Abstract Research has demonstrated that people generally think both their knowledge and performance levels are greater than they are. Although several studies have suggested that knowledge and progress visualization offered by open learner modeling (OLM) technology might influence students’ self-awareness in a positive way, insufficient evidence ex...
Poster
Full-text available
Ovarian cancer (OvCa) can be a deadly gynecological cancer affecting about 22k women per year in the United States with a significant recurrence rate [1]. Women with OvCa and their caregivers often seek support from online health communities (OHCs) [2]. These OHCs allow for the exchange of information and resources with other individuals who have h...
Article
Full-text available
Finding research advisors is an important and challenging task for college students. On one hand, a research advisor that matches student interests and past preparation could fully engage the student with an exciting and productive research experience. On the other hand, students are frequently unable to formulate their interests and experience in...
Conference Paper
Full-text available
Meeting other scholars at conferences is often a stochastic, intuition-driven process. Social recommender systems can support identifying new collaboration partners that one might not naturally choose. However, to boost the accumulation of social capital, such systems must be designed for diversifying social connections. This paper draws from the e...
Chapter
In this paper, we introduce an approach that combines automatic domain knowledge modeling, student modeling, and content recommendation approaches to recommend relevant Wikipedia articles for students working with online electronic textbooks.
Chapter
Full-text available
Previous research on technology-enhanced learning indicated that exposing students to information related to their peers’ performance might positively or negatively affect their behavior and performance. For example, recent research has demonstrated that augmenting traditional open learner models (OLMs) with views of the learner model of peers coul...
Conference Paper
Full-text available
This paper presents our attempt to create an exploratory search system CovEx for a collection of academic papers related to COVID-19. CovEx uses concept extraction, knowledge graphs, and user-controlled recommendation to assist users with various levels of domain expertise in their information needs. CCS CONCEPTS • Information systems → Graph-based...
Article
The increasing popularity of digital textbooks as a new learning media has resulted in a growing interest in developing a new generation of adaptive textbooks that can help readers to learn better through adapting to the readers’ learning goals and the current state of knowledge. These adaptive textbooks are most frequently powered by internal know...
Conference Paper
Full-text available
Assessment plays a vital role in learning, as it provides both instructors and students with feedback on the overall effectiveness of their teaching or learning. However, when a student fails to correctly answer certain questions in an assessment (such as a quiz), the student needs specific recommendations that are tailored to their learning needs...
Conference Paper
Full-text available
Over the last 10 years, the world experienced a rapid increase in volume and diversity of digital learning resources. The abundance of digital resources could support a range of powerful educational scenarios, which were not available before. In this paper, we introduce a novel approach that combines fully automatic knowledge modeling, student mode...
Preprint
Full-text available
This paper presents our attempt to create an exploratory search system CovEx for a collection of academic papers related to COVID-19. CovEx uses concept extraction, knowledge graphs, and user-controlled recommendation to assist users with various levels of domain expertise in their information needs. CCS CONCEPTS • Information systems → Graph-based...
Conference Paper
Full-text available
Finding research advisors is an important and challenging task for college students. On one hand, a research advisor that matches student interests and past preparation could fully engage the student with an exciting and productive research experience. On the other hand, students are frequently unable to formulate their interests and experience in...
Conference Paper
Full-text available
Behnam Rahdari [0000−0001−6514−912X] , Peter Brusilovsky [0000−0002−1902−1464] , Khushboo Thaker [0000−0003−3619−9376] , and Jordan Barria-Pineda [0000−0002−4961−4818] Abstract. In this paper, we introduce an approach that combines automatic domain knowledge modeling, student modeling, and content recommendation approaches to recommend relevant Wik...
Conference Paper
Full-text available
Over the past two decades, several information exploration approaches were suggested to support a special category of search tasks known as exploratory search. These approaches creatively combined search, browsing, and information analysis steps shifting user efforts from recall (formulating a query) to recognition (i.e., selecting a link) and help...
Article
This research is focused on how to support students’ acquisition of program construction skills through worked examples. Although examples have been consistently proven to be valuable for student’s learning, the learning technology for computer science education lacks program construction examples with interactive elements that could engage student...
Preprint
Full-text available
With the increased popularity of electronic textbooks, there is a growing interests in developing a new generation of "intelligent textbooks", which have the ability to guide the readers according to their learning goals and current knowledge. The intelligent textbooks extend regular textbooks by integrating machine-manipulatable knowledge such as...
Conference Paper
Full-text available
Recent studies have shown that students follow stable behav-ioral patterns while learning in online educational systems. These behavioral patterns can further be used to group the students into different clusters. However, as these clusters include both high-and low-performance students, the relation between the behavioral patterns and student perf...
Conference Paper
Full-text available
Recommender system helps users to reduce information overload. In recent years, enhancing explainability in recommender systems has drawn more and more attention in the field of Human-Computer Interaction (HCI). However, it is not clear whether a user-preferred explanation interface can maintain the same level of performance while the users are exp...
Conference Paper
Full-text available
In this work-in-progress paper, we presented a participatory process of designing explanation interfaces for a social recommender system with multiple explanatory goals. We went through four stages to identify the key components of the recommendation model, expert mental model, user mental model, and target mental model. We reported the results of...
Chapter
Full-text available
The idea of self-improving intelligent educational systems is almost as old as the field of intelligent educational systems itself. The origin of this research stream could be traced to the paper of Tim O’Shea “A selfimproving quadratic tutor” (O'Shea, 1982), which was published 40 years ago in the famous special issue of International Journal on t...
Article
Full-text available
Tag clouds have been utilized as a “social” way to find and visualize information, providing both one-click access and a snapshot of the “aboutness” of a tagged collection. While many research projects have explored and compared various tag artifacts using information theory and simulations, fewer studies have been conducted to compare the effectiv...
Conference Paper
Full-text available
As an interactive intelligent system, recommender systems are developed to give recommendations that match users' preferences. Since the emergence of recommender systems, a large majority of research focuses on objective accuracy criteria and less attention has been paid to how users interact with the system and the efficacy of interface designs fr...
Chapter
Full-text available
Although many efforts are being made to provide educators with dashboards and tools to understand student behaviors within specific technological environments (learning analytics), there is a lack of work in supporting educators in making data-informed design decisions when designing a blended course and planning learning activities. In this paper,...
Preprint
Full-text available
Recently, concatenating multiple keyphrases as a target sequence has been proposed as a new learning paradigm for keyphrase generation. Existing studies concatenate target keyphrases in different orders but no study has examined the effects of ordering on models' behavior. In this paper, we propose several orderings for concatenation and inspect th...
Article
Information-seeking tasks with learning or investigative purposes are usually referred to as exploratory search. Exploratory search unfolds as a dynamic process where the user, amidst navigation, trial and error, and on-the-fly selections, gathers and organizes information (resources). A range of innovative interfaces with increased user control ha...
Article
Full-text available
The beyond-relevance objectives of recommender systems have been drawing more and more attention. For example, a diversity-enhanced interface has been shown to associate positively with overall levels of user satisfaction. However, little is known about how users adopt diversity-enhanced interfaces to accomplish various real-world tasks. In this ar...
Article
Full-text available
Researchers in many disciplines are developing novel interactive smart learning objects like exercises and visualizations. Meanwhile, Learning Management Systems (LMS) and eTextbook systems are also becoming more sophisticated in their ability to use standard protocols to make use of third party smart learning objects. But at this time, educational...
Conference Paper
Full-text available
Recommending experts is an important challenge in many contexts. In this paper, we present a method to build a knowledge graph by integrating data from Google Scholar and Wikipedia to help students find a research advisor or thesis committee member. This knowledge graph is used to power the exploratory search interface to recommend similar keywords...
Chapter
Full-text available
Recent studies of student problem-solving behavior have shown stable behavior patterns within student groups. In this work, we study patterns of student behavior in a richer self-organized practice context where student worked with a combination of problems to solve and worked examples to study. We model student behavior in the form of vectors of m...
Conference Paper
Full-text available
Students might pursue different goals throughout their learning process. For example, they might be seeking new material to expand their current level of knowledge, repeating content of prior classes to prepare for an exam, or working on addressing their most recent misconceptions. Multiple potential goals require an adaptive e-learning system to r...
Article
This paper outlines RSR, a relational social recommendation approach applied to a social graph comprised of relational entity profiles. RSR uses information extraction and learning methods to obtain relational facts about persons of interest from the Web, and generates an associative entity-relation social network from their extracted personal prof...
Conference Paper
Full-text available
A hybrid recommender system fuses multiple data sources, usually with static and nonadjustable weightings, to deliver recommendations. One limitation of this approach is the problem to match user preference in all situations. In this paper, we present two user-controllable hybrid recommender interfaces, which offer a set of sliders to dynamically t...
Conference Paper
Full-text available
The increasing utilization of massive open online courses has significantly expanded global access to formal education. Despite the technology's promising future, student interaction on MOOCs is still a relatively under-explored and poorly understood topic. This work proposes a multi-level pattern discovery through hierarchical discriminative tenso...
Preprint
Full-text available
The purpose of this research is to study the possibility of identifying students, statistically, by analyzing their behavior in different consecutive activities. In this project, there are three different sorts of activities: animated example, basic example, and parameterized exercises. We extracted the behavior of each student from the log activit...
Conference Paper
Full-text available
A hybrid recommender system fuses multiple data sources to deliver recommendations. One challenge of this approach is to match the changing user preferences with a list of static recommendations. In this paper, we present two user-controllable hybrid recommender interfaces, Relevance Tuner (for people recommendation) and Paper Tuner (for paper reco...
Conference Paper
Full-text available
Recommendations for online educational systems generally differ from recommendations generated in other contexts (e.g. movies, e-commerce), given that students’ level of knowledge rather then their interests is key for suggesting the most appropriate content. Thus, the challenge of making recommendations more transparent is closely tied to how stud...
Conference Paper
Full-text available
Hybrid social recommender systems use social relevance from multiple sources to recommend relevant items or people to users. To make hybrid recommendations more transparent and controllable, several researchers have explored interactive hybrid recommender interfaces, which allow for a user-driven fusion of recommendation sources. In this field of w...
Conference Paper
Full-text available
We present Paper Tuner, a user-controlled interface for recommending papers and presentations at a research conference. The availability of multiple sources of information about user interests makes hybrid recommendation approach attractive in a conference context, but traditional static parallel hybridization makes is hard to generate a single ran...
Conference Paper
Full-text available
Explainability is an important desired property of recommendation systems. We consider a graph-based recommendation approach, which generates detailed explanations to users in the form of labelled connecting relational paths and present a visualization interface intended to convey such detailed relational information in clear and intuitive manner....
Conference Paper
Full-text available
In this demo paper, we present a visual approach for explaining learning content recommendation in the personalized practice system Mastery Grids. The proposed approach uses a concept-level visualization of student knowledge in Java programming to demonstrate why specific practice content is recommended by the system. The visualized student knowled...
Chapter
Following the popularity of Wikipedia, community authoring systems are increasingly in use as content sharing outlets. As such, a Web-based portal for sharing of user-generated content (e.g., course notes, quiz answers, etc.) shows prospect to be a great tool for social E-Learning. Among others, students are expected to be active contributors in su...
Conference Paper
Full-text available
A sizable body of research on instructional practices supports the use of worked examples for acquiring cognitive skills in domains such as mathematics and physics. Although examples are also important in the domain of programming, existing research on programming examples is limited. Program examples are used by instructors to achieve two importan...
Article
Full-text available
Presents the introductory editorial for this issue of the publication.
Conference Paper
Full-text available
As an interactive intelligent system, recommender systems are developed to give recommendations that match users' preferences. Since the emergence of recommender systems, a large majority of research focuses on objective accuracy criteria and less attention has been paid to how users interact with the system and the efficacy of interface designs fr...
Conference Paper
Full-text available
Adaptive textbooks use student interaction data to infer the current state of student knowledge and recommend the most relevant learning materials. A challenge of student modeling for adaptive textbooks is that conventional student models are constructed based on performance data (quiz or problem-solving). However, students' interactions with onlin...

Questions

Question (1)
Question
The link to the CovEx system reported in just shared paper "CovEx: An Exploratory Search System for COVID-19 Scientific Literature" is here http://scythian.exp.sis.pitt.edu/covex/
Please, leave feedback for improving the system if you have a chance to try it.

Network

Cited By

Projects

Projects (19)
Project
As the Internet has become a prominent source of health information to guide patients’ decision-making and self-management activities, patients strongly indicate they need navigational support to locate appropriate information on the Internet. The overall goal of our project is to build and implement a “Health E-Librarian with Personalized Recommendations (HELPeR)”, a personalized digital librarian that provides individualized, reliable online information relevant to the patient’s needs, interest and knowledge across the disease trajectory.
Project
Exploratory Search and Recommendation Systems