User-agent: *
Disallow:/404.html
Disallow: /api/
Disallow: /js/
Disallow: /*.js$