2 Replies Latest reply on Mar 13, 2015 2:27 AM by varunluthra

    Help with robots.txt configuration

    varunluthra

      We need google to stop crawling this page: /people/varunluthra/people but crawl this one https://community.jivesoftware.com/people/varunluthra

       

      We need to update robots.txt file, if we add this /*people$ in our robots file, would it stop crawling both or just the first one highlighted in red?