Why does it matter?
You can decide how bots can access your website or not
Crawl directive is strictly recommended for search engines
How to check my robots.txt file?
1-Visit your site.com/robotstxt is accessible on the Web
2- In Google Search Console navigate to crawl > robots.txt tester