Navigation

    APPDRAG Community

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular

    REMINDER

    Please be respectful of all AppDragers! Keep it really civil so that we can make the AppDrag community of builders as embracing, positive and inspiring as possible.

    Reappearence of "disallow" status in robots.txt

    Cloud CMS (Pagebuilder, Blog, Shop, Newsletters, Code Editor)
    3
    8
    488
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S
      Stéphane Anciaux last edited by

      Hello,

      We’ve got a problem with the code editor.
      We allowed the indexation of our site in the dashboard (checkbox unchecked). But the robots.txt file still forbade the indexation. We’ve modified that with the code editor and saved the changes. We also erased our blog sitemap. But the day after all of this is back. How can it be possible? Why the robots.txt file shows “disallow” status? Why the changes are not effective? Changes must be saved by another way?

      Is it because we published our site between the two occurences? I read that robots.txt files are re-generated on publish here :
      FireShot Capture 172 - How are search engines supposed to find the blog pages_ - APPDRAG Com_ - community.appdrag.com.png

      Re: How are search engines supposed to find the blog pages?

      Thank you for your time.

      1 Reply Last reply Reply Quote 0
      • Daniel Mulroy
        Daniel Mulroy last edited by

        Hi Stéphane,

        I'm curious about it.

        Can you check your Project Configuration -> Indexed pages and see what is there?

        Click the wrench icon on the left of pagebuilder, then "Indexed Pages"

        Screen Shot 2021-01-06 at 10.45.34 PM.png

        1 Reply Last reply Reply Quote 0
        • S
          Stéphane Anciaux last edited by

          Yep. Here what i've got. Pages are indexed except for two. All is good here.

          pages indexees.png

          1 Reply Last reply Reply Quote 0
          • Wassim
            Wassim last edited by

            It seems your project is on a free offer without domain name, you can't enable indexing on a free offer.

            S 1 Reply Last reply Reply Quote 2
            • S
              Stéphane Anciaux @Wassim last edited by

              @Wassim Hello! The project is shared between two accounts (my boss and mine) and we've got a paid plan with my boss account wich houses the project if i remember correctly.

              1 Reply Last reply Reply Quote 0
              • Wassim
                Wassim last edited by

                I assumed it was the project on your account, if not send us the project id on support@appdrag.com

                1 Reply Last reply Reply Quote 0
                • Wassim
                  Wassim last edited by

                  @Stéphane-Anciaux said in Reappearence of "disallow" status in robots.txt:

                  We allowed the indexation of our site in the dashboard (checkbox unchecked). But the robots.txt file still forbade the indexation. We’ve modified that with the code editor and saved the changes. We also erased our blog sitemap. But the day after all of this is back. How can it be possible? Why the robots.txt file shows “disallow” status? Why the changes are not effective? Changes must be saved by another way?

                  Hi Stéphane,
                  Thank you for your email, the disallow you had were on deleted pages so you didn't see them in the list. It had no effects as those pages didn't exist anymore. I have removed them from the non indexed pages, you will only see brouillon and test-nathan in the robots.txt>disallow.
                  Have a nice day!

                  S 1 Reply Last reply Reply Quote 0
                  • S
                    Stéphane Anciaux @Wassim last edited by

                    @Wassim Perfect! Thank you Wassim.

                    1 Reply Last reply Reply Quote 1
                    • First post
                      Last post