{"id":1090,"date":"2019-05-16T16:28:09","date_gmt":"2019-05-16T13:28:09","guid":{"rendered":"https:\/\/artem.services\/?p=1090"},"modified":"2019-05-16T16:33:12","modified_gmt":"2019-05-16T13:33:12","slug":"elasticsearch-%d0%ba%d0%be%d0%bf%d0%b8%d1%80%d0%be%d0%b2%d0%b0%d1%82%d1%8c-%d1%81%d0%be%d0%b4%d0%b5%d1%80%d0%b6%d0%b8%d0%bc%d0%be%d0%b5-%d0%be%d0%b4%d0%bd%d0%be%d0%b3%d0%be-%d0%b4%d0%be%d0%bc%d0%b5","status":"publish","type":"post","link":"https:\/\/artem.services\/?p=1090","title":{"rendered":"Elasticsearch — \u041a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0435 \u043e\u0434\u043d\u043e\u0433\u043e \u0434\u043e\u043c\u0435\u043d\u0430 \u0432 \u0434\u0440\u0443\u0433\u043e\u0439"},"content":{"rendered":"

\"\"<\/p>\n

 <\/p>\n

\u0414\u043b\u044f \u0442\u043e\u0433\u043e, \u0447\u0442\u043e\u0431\u044b \u0441\u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u0432\u0441\u0435 \u0438\u043d\u0434\u0435\u043a\u0441\u044b \u0441 \u043e\u0434\u043d\u043e\u0433\u043e \u0434\u043e\u043c\u0435\u043d\u0430 \u0432 \u0434\u0440\u0443\u0433\u043e\u0439 \u0432\u043e\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c\u0441\u044f \u0443\u0442\u0438\u043b\u0438\u0442\u043e\u0439 elasticdump<\/a><\/p>\n

\u0414\u043b\u044f \u0443\u0442\u0438\u043b\u0438\u0442\u044b elasticdump<\/strong> \u043d\u0443\u0436\u043d\u0435\u043d npm<\/strong>, \u0435\u0441\u043b\u0438 \u0438\u0445 \u043d\u0435\u0442, \u0442\u043e \u0443\u0441\u0442\u0430\u043d\u0430\u0432\u043b\u0438\u0432\u0430\u0435\u043c nodejs<\/strong> \u0438 npm<\/strong>:<\/p>\n

\r\nyum install -y gcc-c++ make\r\ncurl -sL https:\/\/rpm.nodesource.com\/setup_6.x | sudo -E bash -\r\nyum install nodejs\r\n<\/pre>\n
 <\/p>\n
\u0423\u0441\u0442\u0430\u043d\u0430\u0432\u043b\u0438\u0432\u0430\u0435\u043c elasticdump<\/strong>:<\/p>\n
\r\nnpm install elasticdump -g\r\n<\/pre>\n
 <\/p>\n
\u0421\u043e\u0437\u0434\u0430\u0434\u0438\u043c \u0441\u043a\u0440\u0438\u043f\u0442, \u043f\u0440\u0435\u0434\u0432\u0430\u0440\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u0443\u043a\u0430\u0437\u0430\u0432 \u0432 \u043f\u0435\u0440\u0435\u043c\u0435\u043d\u043d\u044b\u0445 old_instance<\/strong> \u0438 new_instance<\/strong> URL<\/strong> \u0441\u0432\u043e\u0438\u0445 ES<\/strong> \u0434\u043e\u043c\u0435\u043d\u043e\u0432.<\/p>\n
\r\ncat <<EOF >elastic_dump.sh\r\n#!\/bin\/bash\r\n\r\nold_instance="https:\/\/vpc-artem-old.eu-central-1.es.amazonaws.com"\r\nnew_instance="https:\/\/vpc-artem-new.eu-central-1.es.amazonaws.com"\r\n\r\nes_indexes=$(curl -s "${old_instance}\/_cat\/indices" | awk '{ print $3 }')\r\n\r\nfor index in $es_indexes; do\r\n  elasticdump \\\r\n    --input="${old_instance}\/${index}" \\\r\n    --output="${new_instance}\/${index}" \\\r\n    --type=mapping\r\n\r\n  elasticdump \\\r\n    --input="${old_instance}\/${index}" \\\r\n    --output="${new_instance}\/${index}" \\\r\n    --type=data\r\ndone\r\nEOF\r\n<\/pre>\n
 <\/p>\n
\u0414\u0435\u043b\u0430\u0435\u043c \u0441\u043a\u0440\u0438\u043f\u0442 \u0438\u0441\u043f\u043e\u043b\u043d\u044f\u0435\u043c\u044b\u043c \u0438 \u0437\u0430\u043f\u0443\u0441\u043a\u0430\u0435\u043c:<\/p>\n
\r\nchmod +x elastic_dump.sh\r\n.\/elastic_dump.sh\r\n<\/pre>\n
\u0415\u0441\u043b\u0438 \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 Elasticsearch<\/strong> \u0443 \u0432\u0430\u0441 \u0441\u0435\u0440\u0432\u0438\u0441 AWS<\/strong>, \u0442\u043e \u043d\u0435 \u0434\u043e\u043b\u0436\u043d\u043e \u0431\u044b\u0442\u044c \u0430\u0432\u0442\u043e\u0440\u0438\u0437\u0430\u0446\u0438\u0438 \u0432 Elasticsearch<\/strong> \u043d\u0430 \u043c\u043e\u043c\u0435\u043d\u0442 \u043c\u0438\u0433\u0440\u0430\u0446\u0438\u0438, \u0434\u043b\u044f \u044d\u0442\u043e\u0433\u043e \u043c\u043e\u0436\u043d\u043e \u0440\u0430\u0437\u0440\u0435\u0448\u0438\u0442\u044c \u0434\u043e\u0441\u0442\u0443\u043f \u043e\u0441\u043d\u043e\u0432\u044b\u0432\u0430\u044f\u0441\u044c \u043d\u0430 SecurityGroup<\/strong> \u0438 VPC<\/strong>:<\/p>\n
\r\n{\r\n  "Version": "2012-10-17",\r\n  "Statement": [\r\n    {\r\n      "Effect": "Allow",\r\n      "Principal": {\r\n        "AWS": "*"\r\n      },\r\n      "Action": "es:*",\r\n      "Resource": "arn:aws:es:eu-central-1:XXXXXXXXXXXX:domain\/artem-old\/*"\r\n    }\r\n  ]\r\n}\r\n<\/pre>\n
 <\/p>\n
eu-central-1 — \u0440\u0435\u0433\u0438\u043e\u043d AWS
\nXXXXXXXXXXXX — ID \u0443\u043a\u0430\u0443\u043d\u0442\u0430 AWS
\nartem-old — \u0438\u043c\u044f Elasticsearch \u0434\u043e\u043c\u0435\u043d\u0430<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"
  \u0414\u043b\u044f \u0442\u043e\u0433\u043e, \u0447\u0442\u043e\u0431\u044b \u0441\u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u0432\u0441\u0435 \u0438\u043d\u0434\u0435\u043a\u0441\u044b \u0441 \u043e\u0434\u043d\u043e\u0433\u043e \u0434\u043e\u043c\u0435\u043d\u0430 \u0432 \u0434\u0440\u0443\u0433\u043e\u0439 \u0432\u043e\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c\u0441\u044f \u0443\u0442\u0438\u043b\u0438\u0442\u043e\u0439 elasticdump \u0414\u043b\u044f \u0443\u0442\u0438\u043b\u0438\u0442\u044b elasticdump \u043d\u0443\u0436\u043d\u0435\u043d npm, \u0435\u0441\u043b\u0438 \u0438\u0445 \u043d\u0435\u0442, \u0442\u043e \u0443\u0441\u0442\u0430\u043d\u0430\u0432\u043b\u0438\u0432\u0430\u0435\u043c nodejs \u0438 npm:   \u0423\u0441\u0442\u0430\u043d\u0430\u0432\u043b\u0438\u0432\u0430\u0435\u043c elasticdump:   \u0421\u043e\u0437\u0434\u0430\u0434\u0438\u043c \u0441\u043a\u0440\u0438\u043f\u0442, \u043f\u0440\u0435\u0434\u0432\u0430\u0440\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u0443\u043a\u0430\u0437\u0430\u0432 \u0432 \u043f\u0435\u0440\u0435\u043c\u0435\u043d\u043d\u044b\u0445 old_instance \u0438 new_instance URL \u0441\u0432\u043e\u0438\u0445 ES \u0434\u043e\u043c\u0435\u043d\u043e\u0432.   \u0414\u0435\u043b\u0430\u0435\u043c \u0441\u043a\u0440\u0438\u043f\u0442 \u0438\u0441\u043f\u043e\u043b\u043d\u044f\u0435\u043c\u044b\u043c \u0438 \u0437\u0430\u043f\u0443\u0441\u043a\u0430\u0435\u043c: \u0415\u0441\u043b\u0438 \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 Elasticsearch … \u041f\u0440\u043e\u0434\u043e\u043b\u0436\u0438\u0442\u044c \u0447\u0438\u0442\u0430\u0442\u044c "Elasticsearch — \u041a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0435 \u043e\u0434\u043d\u043e\u0433\u043e \u0434\u043e\u043c\u0435\u043d\u0430 \u0432 \u0434\u0440\u0443\u0433\u043e\u0439"<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[2],"tags":[829,28,723],"_links":{"self":[{"href":"https:\/\/artem.services\/index.php?rest_route=\/wp\/v2\/posts\/1090"}],"collection":[{"href":"https:\/\/artem.services\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/artem.services\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/artem.services\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/artem.services\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1090"}],"version-history":[{"count":2,"href":"https:\/\/artem.services\/index.php?rest_route=\/wp\/v2\/posts\/1090\/revisions"}],"predecessor-version":[{"id":1092,"href":"https:\/\/artem.services\/index.php?rest_route=\/wp\/v2\/posts\/1090\/revisions\/1092"}],"wp:attachment":[{"href":"https:\/\/artem.services\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1090"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/artem.services\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1090"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/artem.services\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1090"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}