Results of the summarizing process for the arXiv paper: 1608.00905v2

The use of social media by first responders to identify and reduce crime is becoming increasingly common. However, images shared on social media can often instigate violence and create law and order situations in society by hurting religious, political, communal, and other sentiments of people. As a result, there is a need for first responders to inspect the spread of such images and users propagating them on social media. To address this issue, researchers have proposed an Open-Source-Intelligent (OSINT) real-time image search system that is robust enough to retrieve modified images. The system allows first responders to analyze the current spread of images, sentiments floating around them, and details of users propagating such content. The researchers compared different hand-crafted features with a Convolutional Neural Network (CNN) model to retrieve similar images. They found that the CNN model outperformed state-of-the-art hand-crafted features. The proposed system aids officials in saving time by reducing the search space by an average of 67%. Previous studies have shown that if there is an image attached to a tweet, it increases user engagement by 35%. However, the role of social media images remains largely unstudied. Some studies have analyzed Twitter images related to events like sports, law & politics, art, culture etc., while others have developed tools to show trending images or find duplicates using text as query or basic hand-crafted features for finding image similarity. The researchers collected data related to five events that created law and order issues in society from October 2015 to February 2016 using Twitter's search API filtering tweets containing images. They created a new human-annotated dataset of viral images for each event. Overall, this work emphasizes the needs of first responders to analyze image spread on social media and provides techniques for image retrieval with the query as an image. The proposed system aids in data management for first responders while helping them reduce search space for images. The researchers experimentally show that ORB (Oriented Fast and Rotated Brief) in combination with RANSAC is the state-of-the-art technique in hand-crafted image features for identifying similar images. They also propose a supervised deep CNN model that outperforms state-of-the-art hand-crafted techniques to retrieve similar images.

• - The use of social media by first responders to identify and reduce crime is increasing
• - Images shared on social media can instigate violence and create law and order situations by hurting sentiments of people
• - There is a need for first responders to inspect the spread of such images and users propagating them on social media
• - Researchers have proposed an Open-Source-Intelligent (OSINT) real-time image search system that retrieves modified images, allowing first responders to analyze the current spread of images, sentiments floating around them, and details of users propagating such content
• - The CNN model outperformed state-of-the-art hand-crafted features in retrieving similar images
• - The proposed system reduces the search space for images by an average of 67%
• - Social media images remain largely unstudied in terms of their role in creating law and order situations
• - Researchers collected data related to five events that created law and order issues from Twitter's search API filtering tweets containing images, creating a new human-annotated dataset of viral images for each event
• - ORB in combination with RANSAC is the state-of-the-art technique in hand-crafted image features for identifying similar images
• - A supervised deep CNN model outperforms state-of-the-art hand-crafted techniques to retrieve similar images.

1. First responders are using social media to help prevent crime. 2. Sometimes, pictures on social media can make people angry and cause problems. 3. First responders need to check these pictures and the people who share them. 4. Researchers made a tool that helps first responders find these pictures faster and understand what people think about them. 5. The tool uses a type of computer program called CNN, which is better than other tools at finding similar pictures. Definitions- Social media: websites and apps where people can share information and connect with others online - Sentiments: feelings or emotions - Open-Source-Intelligent (OSINT): a type of technology that helps people find information online - Retrieves: finds or gets something back - Modified images: pictures that have been changed in some way - CNN model: a type of computer program used for analyzing images - State-of-the-art: the most advanced or best available technology - Hand-crafted features: manually created techniques for analyzing images - Search space: the area where something is being looked for - Law and order situations: times when there is a problem with following rules or laws

Social Media Images and First Responders: An Open-Source-Intelligent (OSINT) Real-Time Image Search System

The use of social media by first responders to identify and reduce crime is becoming increasingly common. However, images shared on social media can often instigate violence and create law and order situations in society by hurting religious, political, communal, and other sentiments of people. As a result, there is a need for first responders to inspect the spread of such images and users propagating them on social media. To address this issue, researchers have proposed an Open-Source-Intelligent (OSINT) real-time image search system that is robust enough to retrieve modified images. The system allows first responders to analyze the current spread of images, sentiments floating around them, and details of users propagating such content.

Background

Previous studies have shown that if there is an image attached to a tweet, it increases user engagement by 35%. However, the role of social media images remains largely unstudied. Some studies have analyzed Twitter images related to events like sports, law & politics, art & culture etc., while others have developed tools to show trending images or find duplicates using text as query or basic hand-crafted features for finding image similarity.

Data Collection

The researchers collected data related to five events that created law and order issues in society from October 2015 to February 2016 using Twitter's search API filtering tweets containing images. They created a new human-annotated dataset of viral images for each event.

Proposed System

The proposed system aids officials in saving time by reducing the search space by an average of 67%. It also helps in data management for first responders while helping them reduce search space for similar images retrieval tasks with query as an image instead of text queries used previously in existing techniques like Google reverse image search or TinEye reverse image search etc.. The researchers experimentally show that ORB (Oriented Fast and Rotated Brief) in combination with RANSAC is the state-of-the-art technique in handcrafted image features for identifying similar images. They also propose a supervised deep CNN model that outperforms state-of-the art handcrafted techniques to retrieve similar images when compared against different feature descriptors like SIFT (Scale Invariant Feature Transform), SURF (Speeded Up Robust Features), BRIEF (Binary Robust Independent Elementary Features).

Conclusion

Overall this work emphasizes the needs of first responders to analyze image spread on social media platforms like Twitter which has become one among many sources through which information about any incident spreads quickly across large populations within seconds leading up into chaos if not handled properly at right time . The proposed OSINT real time intelligent system provides techniques for efficient retrieval methods with query as an inputted image rather than text queries used previously thus aiding officials save time by reducing their overall searching space significantly .