Data Sourcing for Recruitment Business

Client : Talent and Team pvt. ltd.

Description

Talent and Team pvt. ltd. is a staffing agency specializing in the sales and marketing recruitment domain based in India. It is operated and managed by founder Shubham Bisht, who holds 3+ years of experience in the Human Resources industry.

Client Background

TNT is a dynamic third-party recruitment agency specializing in the sales niche in India. With a sharp focus on lower to medium-level hiring, they cater to roles like Sales Executives, Field Sales Executives, BDAs, and team leaders. Their expertise spans across industries such as EdTech, eCommerce, FMCG, EV Tech, and ePayment Gateway, Food Technology/Online Food Delivery Solutions.

Their mission is to empower businesses by connecting them with the right talent while addressing recruitment challenges like talent sourcing and retention. Leveraging market insights, digital strategies, TNT aims to be the go-to partner for organizations seeking exceptional sales talent.

Their team has a proven track record in hiring sales executives in high-demand industries such as ePayment gateway, FMCG, EV Tech, Food Technology / Online Food Delivery. They are well versed in navigating through the fast-paced hiring needs of startups, SMEs, and large scale enterprises. By leveraging market insights and innovative recruitment strategies, they help businesses attract and retain top talent in competitive markets.

Business Functions

• Talent Acquisition

  • Identifying Candidates

  • Screening Candidates

• Customizing Hiring Solutions

• End-to-End Recruitment

• Market Research

• Retention Strategies

Problem Identification

Due to the nature of TNTs offerings and the ever-changing recruitment domain, keeping up with the trends in hiring is a challenge that the TNT team needs to solve for. One of the core challenges that they face is reliability on market trends for tailored hiring solutions. Their clients wish to ensure that top talent is attracted for their vacancies. The need for an analytical and data-driven approach was communicated to us in order to gain deeper insight into industry trends and gain a competitive edge.

Need:

Upon further inquiry, it was discovered that TNT pvt. ltd. looks to develop a real-time database which can serve the following purposes:

• Identify prospective competitors in the staffing and recruitment industry.

• Analyze and monitor the tools and technologies available in the domain.

• Gather reviews and feedback to pinpoint key pain points in sales and marketing recruitment.

Proposed Solution:

In order to fulfil their needs, we proposed the collection of data from open-source websites where recruitment information is available in the form of job listings and employee reviews. This would potentially enable them to scan the market for similar job roles, the kind of demands being made as criteria for eligibility in those roles, the precise nature of skills expected from oncoming candidates, the compensation packages, and benefits packages being offered to attract top talent.

Methodologies:

• Data collection via Web Scraping:

  Data scraping, alternatively known as web scraping is a fundamental data collection technique used to extract information stored on websites. For TNT pvt. ltd., it was proposed that the latest hiring data could be gathered from job aggregators in order to understand the levers being used by various other players to attract the talent pool such as salary offerings and benefits. Other information that would be available from our extraction efforts would include roles and responsibilities, employer information, job location and job age. By combining these data points across different websites and industries TNT private limited would be able to draw certain assumptions as well as arrive at conclusions regarding the availability of talent pool, their expectations and use the information to curate high-quality tailor made solutions for their clients.

• Data Analytics using Analytics Software:

  Post extraction of the desired information via the suggested sources an analytical procedure is advised which will make the collected information available to be utilized and taken advantage of. In order to execute the analytical process we have offered the use of Power BI services and other services like Microsoft Access and SQL so that the decision makers at TNT private limited are not only able to access the collected information in the form of spreadsheets but also visualize the information and manipulate it based on their specific inquiries. The software that needs to be deployed for the analytical procedures shall be ascertained based on the volume of data collected.

  
  

Project Requirements:

In order to successfully implement our strategies we requested TNT private limited for the following details about their specific requirements:

• Scraping Focus - Highlights the nature of information that needs to be extracted and expectations regarding volume and variety.

• Sources - The recommended sources where the scraping efforts needs to be directed.

• Analytical Expectation - The expected outcomes of analysis and the magnitude of manipulative flexibility required for in-house analysis.

The goal of sharing these requirements across to the client is to ascertain the kind of information that needs to be extracted, the volume that would satisfy their decision making requirements and ensuring that the analytical prowess transferred remains flexible and insightful to multiple stakeholders.

Ethics Protocols:

As we have proposed the use of web-scraping which is the extraction of information from websites using scraping software of codes, the legality and ethics of data extraction from the web are still relatively a grey area. Although, existing legal frameworks is to a certain extent applied to web scraping.

There are several laws that govern the protection of data that is available online such as:

• The Computer Misuse Act, 1990

• The Data Protection Act, 2018

• The Copyright, Designs, and Patents Act, 1988

• The General Data Protection Regulation (GDPR or UK-GDPR)

• Database Protection (Directive 96/9/EC of the European Parliament and of the Council of 11 March 1996 on the legal protection of databases.) 

• Information Technology Act 1990 (India)

It has been sincerely requested from the client to provide verified sources for data extraction however, checks will be performed by us to ensure that the sources have publicly available APIs or allow to direct scraping activities.

We intend to take the following steps to ensure that our scraping activities are ethical and safe:

• Using Public API when available and avoid scraping all together if the data is available through the API.

• Passing data through a user agent string to identify us as scrapers.

• Scraping data at a reasonable rate and throttle/control the number of requests per second. The website owner must not think it is a DDoS attack.

• Making sure that we save only the data we need.

• Not scraping private data by paying attention to the site’s robots.txt and analytics needs to avoid scraping data from sensitive areas.

• Develop a formal Data Collection Policy for internal stakeholders.

Success Criteria:

Based on our discussions with the client, we intend to develop a real-time database i.e data that can update itself within the desired timeframes such that the information available is up-to-date and readily available for usage.

Our objective is to collect information, and organize a dataset of more than 3000 job listings with the following attributes:

1)      Job Title

2)      Company Name

3)      Job Location

4)      Job Description

5)      Salary Range

6)      Posting Date

7)      Job Type (Full-Time, Contract, Part-time)

8)      Application Link

9)      Company Benefits