Middle .Net developer

 Looking for a software developer to write a code that will integrate into the current infrastructure and expand its current capabilities by adding additional sites to be crawled, parsed and saved to the database.

“The sites which we scrap aren’t static – the requests which we send, each is with different parameters (you may think of it as crawling Amazon\eBay each time with different item id).

The WCF service supports running configure a number of requests per minute (so no DDoS will be caused) per site.

The responses are being parsed and saved to Microsoft SQL server over EF.

The service works well and now we are looking to add additional sites – each site unique in mainly two aspects-

1. The requests need to be sent in order to query the data – it should mimic the website itself so the sending won’t ban. 

2. The parser that parsed the data and constructs the DAL entities out of the parsed data. 

I hope this helps you better understand the business and what we are looking for.

Required skills –  English to communicate on a daily basis 

Web development skills (ability to create requests \ responses that crawl sites).

Entity Framework

SQL databases 

.Net framework 4.7.2 the async\await mechanism and tuples is a must

WCF or any other.Net service knowledge

.net core – a big plus

Angular – a big plus

Azure\AWS\google cloud – a big plus